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(57) Encoding parameters of picture and higher lay- 
ers of importance to a number of applications, and en- 
coding parameters of slice and lower layers of no impor- 
tance to all applications are converted into auxiliary 
packets inserted respectively into a V-blanking area and 
an H-blanking area of a video-data signal output by a 
history-information-multiplexing apparatus employed in 



a video-decoding system. On the other hand, a video- 
encoding system extracts back the auxiliary packets su- 
perposed on the V-blanking area and the H-blanking ar- 
ea from an input base-band video signal. As a result, a 
technique of superposing information on data can be 
changed in accordance with the importance of the infor- 
mation and required information can be fetched with 
ease. 
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Description 

[0001] The present invention relates to an informa- 
tion-processing apparatus, an information-processing 
method and a recording medium. More particularly, the 
present invention relates to an information-processing 
apparatus, an information-processing method and a re- 
cording medium of a transcoding system that allow in- 
formation to be transmitted in such a way that necessary 
information can be extracted from the transmitted infor- 
mation with ease in dependence on the degree of infor- 
mation importance, and allow information to be read out 
from the information-recording medium wherein the pic- 
ture quality does not deteriorate even if decoding and 
encoding processes are carried out repeatedly to modify 
the structure of an encoded bit stream completing an 
encoding process based on an MPEG (Moving Picture 
Expert Group) standard. 

[0002] in recent years, in a broadcasting station for 
producing and broadcasting television programs, an 
MPEG technology is generally adopted to carry out 
processing to compress and/or encode video data. In 
particular, the MPEG technology is becoming a de-facto 
standard for recording video data into a random-access 
recording medium material or a tape and transmitting 
video data through a cable or by way of a satellite. 
[0003] The following description briefly explains typi- 
cal processing carried out at a broadcasting station up 
to transmission of a video program produced at the 
broadcasting station to homes. First of all, an encoder 
employed in a cam-coder encodes source video data 
and records the encoded data onto a magnetic tape of 
a VTR (Video Tape Recorder). A cam-coder is an appa- 
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eo data. Then, the base-band video signal is re-encoded 
so as to convert each picture into an I picture. By carry- 
ing out decoding and re-encoding processes in this way ; 
it is possible to generate a bit stream having a GOP 
structure suitable for the edit processing. 
[0005] Next, in order to transmit an edited video pro- 
gram obtained as a result of the editing described above 
from the main broadcasting station to a local broadcast- 
ing station, the GOP structure and the bit rate of the bit 
stream of the edited video program are converted into 
a GOP structure and a bit rate that are suitable for trans- 
mission processing. A GOP structure suitable for trans- 
mission between stations is a GOP structure in which 1 
GOP consists of 15 picture frames such as I, B, B, P, B, 
B, P and so on where notation P represents a picture 
frame of a certain type different from the picture frames 
I and B. On the other hand, a desirable value of the bit 
rate suitable for transmission between stations is at 
least 50 Mbps. This is because a dedicated transmis- 
sion line having a high transmission capacity is gener- 
ally used for transmission between stations. To put it 
concretely, the bit stream of the video program obtained 
as a result of the edit processing is first decoded, being 
restored to base-band video data. Then, the base-band 
video data is re-encoded to convert the GOP structure 
and the bit rate of the base-band video data into a GOP 
structure and a bit rate that are suitable for the trans- 
mission processing. 

[0006] At a local broadcasting station, edit processing 
is carried out to insert commercials unique to the geo- 
graphical area of the local broadcasting station into the 
video program received from the main broadcasting sta- 
tion. That is to say, much like the edit processing de- 
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are integrated to form a single body. At that time, the 
encoder employed in the cam-coder encodes the 
source video data into codes with a recording format 
suitable for the magnetic tape of the VTR. For example, 
in a GOP (Group of Pictures) structure of an MPEG bit 
stream recorded onto the magnetic tape, 1 GOP con- 
sists of 2 picture frames. Thus, an MPEG bit stream is 
a sequence of picture frames such as I, B, I, B, I, B and 
so on where notations I and B represent picture frames 
with different types. An MPEG bit stream is recorded on- 
to a magnetic tape at a bit rate of 1 8 Mbps. 
[0004] Then, edit processing is carried out at a main 
broadcasting station to edit the video bit stream record- 
ed on the magnetic tape. In order to carry out the edit 
processing, the GOP structure of the video bit stream 
recorded on the magnetic tape is converted into a GOP 
structure suitable for the edit processing. In a GOP 
structure suitable for the edit processing, 1 GOP com- 
prises 1 frame and all pictures are I pictures. This is be- 
cause, in order to carry out the edit processing in frame 
units : the I picture is most suitable since the I picture 
has no correlation with other pictures. In an actual edit 
operation, the video bit stream recorded on the magnet- 
ic tape is first decoded, being restored to base-band vid- 
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main broadcasting station is first decoded, being re- 
stored to base-band video data. Then, the base-band 
video signal is re-encoded so as to convert each picture 
into an I picture. By carrying out decoding and encoding 
processes in this way, it is possible to generate a bit 
stream having a GOP structure suitable for the edit 
processing. 

[0007] Next, in order to transmit an edited video pro- 
gram obtained as a result of the editing described above 
from the local broadcasting station to homes, the GOP 
structure and the bit rate of the bit stream of the edited 
video program are converted into a GOP structure and 
a bit rate that are suitable for transmission processing. 
A GOP structure suitable for transmission from a local 
broadcasting station to homes is a GOP structure in 
which 1 GOP consists of 15 picture frames such as I, B, 
B, P, B, B, P and so on. On the other hand, a desirable 
value of the bit rate suitable for transmission from a local 
broadcasting station to homes is about 5 Mbps. To put 
it concretely, the bit stream of the video program ob- 
tained as a result of the edit processing is f irst decoded, 
being restored to base-band video data. Then, the base- 
band video data is re-encoded to convert the GOP struc- 
ture and the bit rate of the base-band video data into a 
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GOP structure and a bit rate that are suitable for the 
transmission processing. 

[0008] As is obvious from the above description, dur- 
ing transmission of a video program from the main 
broadcasting station to homes, decoding and encoding 5 
processes are carried out repeatedly a plurality of times. 
In actuality, processing carried out at a broadcasting sta- 
tion includes various kinds of necessary signal process- 
ing other than the signal processing described above ^ 
and, for each signal processing, decoding and encoding 10 
processes must be performed. 

[0009] Unfortunately, however, encoding and decod- 
ing processes based on the MPEG standard are not 
1 00% reversible processes as is generally known. That 
is to say, video data obtained as a result of a decoding '5 
process is not 1 00% the same as base-band video data 
prior to an encoding process. To be more specific, the 
picture quality deteriorates due to the encoding and de- 
coding processes. To put it in detail, when the encoding 
and decoding processes are carried out repeatedly as 20 
described above, there is raised a problem that the pic- 
ture quality inevitably deteriorates each time a process 
is performed. In other words, each time the decoding 
and/or encoding processes are repeated, the picture 
quality deteriorates cumulatively. 25 
[0010] In order to solve this problenrv there has been 
proposed a technique for preventing the picture quality 
from deteriorating by transmission of an encoding his- 
tory of transmitted video data along with the video data 
and execution of encoding and decoding processes by 30 
using the encoding history. 

[0011] In the execution of the decoding and encoding 
processes, however, a transcoding system may not re- 
quire all parameters in some cases in dependence on 
the application to process pictures. Since an area in 35 
which required data is located is not known, neverthe- 
less, it is necessary to design such hardware that all da- 
ta is accessible to the transcoding system. For this rea- 
son, the hardware becomes unavoidably complicated 
and, as a result, the inform at ion -processing apparatus 40 
inevitably becomes large in scale. In addition, if a packet 
is lost due to an effect of a noise, restoration of data 
including and following the lost packet becomes difficult 
so that it is feared that much data is unavoidably lost. 
[001 2] It is thus an object of at least preferred embod- 45 
iments of the present invention addressing the problems 
described above to provide an information-processing 
apparatus, an information-processing method and a re- 
cording medium that allow information to be transmitted 
in such a way that necessary information can be extract- so 
ed from the transmitted information with ease by modi- 
fying a technique to superpose data in dependence on 
the degree of data importance and by recording the data 
at predetermined locations such as a vertical blanking 
area and a horizontal blanking area, and allow informa- 55 
tion to be read out from the information -recording medi- 
um in a transcoding system wherein the picture quality 
does not deteriorate even if decoding and encoding 



processes are carried out repeatedly to modify the GOP 
structure of an encoded bit stream completing an en- 
coding process based on the MPEG standard. 
[001 3] According to a first aspect of the present inven- 
tion, there is provided an information-processing appa- 
ratus for decoding an input encoded stream and gener- 
ating an output signal, the information-processing appa- 
ratus including extraction means for extracting auxiliary 
data from the input encoded stream, separation means 
for splitting the auxiliary data extracted by the extraction 
means into first auxiliary data and second auxiliary data, 
conversion means for converting the first auxiliary data 
and the second auxiliary data, which were separated by 
the separation means, into data having a predetermined 
format, and insertion means for inserting the first auxil- 
iary data and the second auxiliary data, which were con- 
verted by the conversion means, into a first position and 
a second position of the output signal respectively 
[0014] According to a second aspect of the present 
invention, there is provided an information-processing 
method adopted by an information -processing appara- 
tus for decoding an input encoded stream and generat- 
ing an output signal , the information-processing method 
including an extraction step of extracting auxiliary data 
from the input encoded stream, a separattarv^ep^pf 
splitting the auxiliary data extracted at the extraction 
step into first auxiliary data and second auxiliary^data, 
a conversion step of converting the first auxiliary data 
and the second auxiliary data, which were separated at 
the separation step, into data having a predetermined 
format, and an insertion step of inserting the first auxil- 
iary data and the second auxiliary data, which-were con- 
verted at the conversion step, into a first position and a 
second position of the output signal respectively.^- .. 
[0015] According to a third aspect of the present in- 
vention, there is provided a recording medium employed 
in an information-processing apparatus for decoding an 
input encoded stream and generating an output signal, 
the recording medium used for recording a program ex- 
ecutable by a computer to implement a method includ- 
ing an extraction step of extracting auxiliary data from 
the input encoded stream, a separation step of splitting 
the auxiliary data extracted at the extraction step into 
first auxiliary data and second auxiliary data, a conver- 
sion step of converting the first auxiliary data and the 
second auxiliary data, which were separated at the sep- 
aration step, into data having a predetermined format, 
and an insertion step of inserting the first auxiliary data 
and the second auxiliary data, which were converted at 
the conversion step, into a first position and a second 
position of the output signal respectively. 
[0016] In the information-processing apparatus, the 
information-processing method and the recording me- 
dium, ft is possible to generate and output data from 
which required information can be fetched with ease on 
a reception side. 

[0017] According to a fourth aspect of the present in- 
vention, there is provided an information-processing ap- 
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paratus for encoding an input signal and generating an 
output signal, the information-processing apparatus in- 
cluding extraction means for extracting first auxiliary da- 
ta or second auxiliary data, which were inserted into a 
first position or a second position of the input signal re- 
spectively, selection means for selecting either the first 
auxiliary data or the second auxiliary data, which were 
extracted by the extraction means, and encoding means 
for encoding the input signal by utilizing the first auxiliary 
data or the second auxiliary data, which were selected 
by the selection means. 

[001 8] According to a fifth aspect of the present inven- 
tion, there is provided an information-processing meth- 
od adopted in an information-processing apparatus for 
encoding an input signal and generating an output sig- 
nal, the in formation -processing method including an ex- 
traction step of extracting first auxiliary data or second 
auxiliary data, which were inserted into a first position 
or a second position of the input signal respectively, a 
selection step of selecting either the first auxiliary data 
or the second auxiliary data, which were extracted at the 
extraction step, and an encoding step of encoding the 
input signal by utilizing the first auxiliary data or the sec- 
ond auxiliary data, which were selected at the selection 
step. 

[0019] According to a sixth aspect of the present in- 
vention, there is provided a recording medium employed 
in an information-processing apparatus for encoding an 
input signal and generating an output signal, the record- 
ing medium used for recording a program executable by 
a computer to implement a method including an extrac- 
tion step of extracting first auxiliary data or second aux- 
iliary data, which were inserted into a first position or a 
second position of the input signal respectively, a selec- 
tion step of selecting either the first auxiliary data or the 
second auxiliary data, which were extracted at the ex- 
traction step, and an encoding step of encoding the input 
signal by utilizing the first auxiliary data or the second 
auxiliary data, which were selected at the selection step. 
[0020] In the information-processing apparatus, the 
information-processing method and the recording me- 
dium, it is possible to fetch only necessary information 
with ease from the input signal and use the information 
in an encoding process. 

[0021] According to a seventh aspect of the present 
invention, there is provided an information-processing 
apparatus for generating a second encoded stream 
from a first input encoded stream and outputting the sec- 
ond encoded stream, the information-processing appa- 
ratus including decoding means for decoding the first 
input encoded stream, and generation means forencod- 
ing the first encoded stream decoded by the decoding 
means to generate the second encoded stream, where- 
in the decoding means has first extraction means for ex- 
tracting auxiliary data from the first input encoded 
stream, separation means for splitting the auxiliary data 
extracted by the first extraction means into first auxiliary 
data and second auxiliary data, conversion means for 



converting the first auxiliary data and the second auxil- 
iary data, which were separated by the separation 
means, into data having a predetermined format, and 
insertion means for inserting the first auxiliary data and 

5 the second auxiliary data, which were converted by the 
conversion means, respectively into a first position and 
a second position of the first encoded stream decoded 
by the decoding means, the decoding means decodes 
the first encoded stream by using the auxiliary data ex- 

io tracted by the first extraction means, the generation 
means has second extraction means for extracting the 
first auxiliary data or the second auxiliary data respec- 
tively from the first position or the second position of the 
first encoded stream decoded by the decoding means, 

15 and selection means for selecting either the first auxil- 
iary data or the second auxiliary data, which were ex- 
tracted by the second extraction means, and the gener- 
ation means encodes the first encoded stream decoded 
and supplied thereto by the decoding means by using 

20 the first auxiliary data or the second auxiliary data, which 
was selected by the selection means, to generate the 
second encoded stream. 

[0022] According to an eighth aspect of the present 
invention, there is provided an information-processing 

25 method adopted by an information -processing appara- 
tus for generating a second encoded stream from a first 
input encoded stream and outputting the second encod- 
ed stream, the information-processing method including 
a decoding step of decoding the first input encoded 

30 stream, and a generation step of encoding the first en- 
coded stream decoded at the decoding step to generate 
the second encoded stream, wherein the decoding step 
has a first extraction sub-step of extracting auxiliary data 
from the first input encoded stream, a separation sub- 

35 step of splitting the auxiliary data extracted at the first 
extraction sub-step into first auxiliary data and second 
auxiliary data, a conversion sub-step of converting the 
first auxiliary data and the second auxiliary data, which 
were separated at the separation sub-step, into data 

40 having a predetermined format and an insertion sub- 
step of inserting the first auxiliary data and the second 
auxiliary data, which were converted at the conversion 
sub-step, respectively into a first position and a second 
position of the first encoded stream decoded at the de- 

45 coding step, the decoding step is executed to decode 
the first encoded stream by using the auxiliary data ex- 
tracted at the first extraction sub-step, the generation 
step has a second extraction sub-step of extracting the 
first auxiliary data or the second auxiliary data respec- 

50 tively from the first position or the second position of the 
first encoded stream decoded at the decoding step, and 
a selection sub-step of selecting either the first auxiliary 
data or the second auxiliary data, which was extracted 
at the second extraction sub-step, and the generation 

55 step is executed to encode the first encoded stream de- 
coded and supplied thereto at the decoding step by us- 
ing the first auxiliary data or the second auxiliary data, 
which was selected at the selection sub-step, to gener- 
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ate the second encoded stream. 
[0023] According to a ninth aspect of the present in- 
vention there is provided a recording medium employed 
in an information-processing apparatus for generating 
a second encoded stream from a first input encoded 
stream and outputting the second encoded stream, the 
recording medium used for recording a program execut- 
able by a computer to implement a method including a 
decoding step of decoding the first input encoded 
stream, and a generation step of encoding the first en- 
coded stream decoded at the decoding step to generate 
the second encoded stream, wherein the decoding step 
has a first extraction sub-step of extracting auxiliary data 
from the first input encoded stream, a separation sub- 
step of splitting the auxiliary data extracted at the first 
extraction sub-step into first auxiliary data and second 
auxiliary data, a conversion sub-step of converting the 
first auxiliary data and the second auxiliary data, which 
were separated at the separation sub-step, into data 
having a predetermined format, and an insertion sub- 
step of inserting the first auxiliary data and the second 
auxiliary data, which were converted at the conversion 
sub-step, respectively into a first position and a second 
position of the first encoded stream decoded at the de- 
coding step, the decoding step is executed to* decode 
the first encoded stream by using the auxiliary data ex- 
tracted at the first extraction sub-step, the generation 
step has a second extraction sub-step of extracting the 
first auxiliary data or the second auxiliary data respec- 
tively from the first position or the second position of the 
first encoded stream decoded at the decoding step, and 
a selection sub-step of selecting either the first auxiliary 
data or the second auxiliary data, which was extracted 
at the second extraction sub-step, and the generation 
step is executed to encode the first encoded stream de- 
coded and supplied thereto at the decoding step by us- 
ing the first auxiliary data or the second auxiliary data, 
which was selected at the selection sub-step : to gener- 
ate the second encoded stream. 

[0024] In the information-processing apparatus, the 
information-processing method and the recording me- 
dium, it is possible to fetch only necessary information 
with ease from the input signal and use the information 
in an encoding process. 

[0025] According to a tenth aspect of the present in- 
vention, there is provided a decoding apparatus for de- 
coding an encoded source stream, the decoding appa- 
ratus including decoding means for decoding the encod- 
ed source stream in order to generate a base-band vid- 
eo signal by using encoding parameters included in the 
encoded source stream, vertical insertion means for in- 
serting much required ones among the encoding param- 
eters into a vertical-blanking period of the base-band 
video signal, and horizontal insertion means for insert- 
ing little required ones among the encoding parameters 
into a horizontal-blanking period of the base-band video 
signal. 

[0026] According to an eleventh aspect of the present 



invention, there is provided a decoding method adopted 
by a decoding apparatus for decoding an encoded 
source stream., the decoding method including the steps 
of decoding the encoded source stream in order to gen- 

5 erate a base-band video signal by using encoding pa- 
rameters included in the encoded source stream, insert- 
ing much required ones among the encoding parame- 
ters into a vertical-blanking period of the base-band vid- 
eo signal, and inserting little required ones among the 

10 encoding parameters into a horizontal-blanking period 
of the base-band video signal. 

[0027] According to a twelfth aspect of the present in- 
vention, there is provided a decoding apparatus for de- 
coding an encoded source stream, the decoding appa- 

15 ratus including decoding means for decoding the encod- 
ed source stream in order to generate a base-band vid- 
eo signal by using encoding parameters included in the 
encoded source stream, vertical insertion means for in- 
serting those of picture and higher layers among the en- 

20 coding parameters into a vertical-blanking period of the 
base-band video signal, and horizontal insertion means 
for inserting those of slice and lower layers'among the 
encoding parameters into a horizontal-blanking period 
of the base-band video signal. r: ■ T> 

25 [0028] According to a thirteenth aspect ottrte- present 
invention, there is provided a decoding method adopted 
by a decoding apparatus for decoding an encoded 
source stream, the decoding method including the steps 
of decoding the encoded source stream in order to gen- 

30 erate a base-band video signal by using encoding pa- 
rameters included in the encoded source stream; insert- 
ing those of picture and higher layers among the encod- 
ing parameters into a vertical-blanking period *of the 
base-band video signal, and inserting those of 'slice. and 

35 lower layers among the encoding parameters into a hor- 
izontal-blanking period of the base-band video signal. 
[0029] According to a fourteenth aspect of the present 
invention, there is a decoding apparatus for decoding 
an encoded source stream, the decoding apparatus in- 

40 eluding decoding means for decoding the encoded 
source stream in order to generate a base-band video 
signal by using encoding parameters included in the en- 
coded source stream, vertical insertion means for insert- 
ing general ones among the encoding parameters into 

45 a vertical-blanking period of the base-band video signal , 
and horizontal insertion means for inserting detailed 
ones among the encoding parameters into a horizontal- 
blanking period of the base-band video signal. 
[0030] According to a fifteenth aspect of the present 

so invention, there is provided a decoding method adopted 
by a decoding apparatus for decoding an encoded 
source stream, the decoding method including the steps 
of decoding the encoded source stream in order to gen- 
erate a base-band video signal by using encoding pa- 
ss rameters included in the encoded source stream, insert- 
ing general ones among the encoding parameters into 
a vertical-blanking period of the base-band video signal, 
and inserting detailed ones among the encoding param- 
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eters into a horizontal-blanking period of the base-band 
video signal. 

[0031] According to a sixteenth aspect of the present 
invention, there is provided an encoding apparatus for 
encoding a base-band video signal, the encoding appa- 
ratus including extraction means for extracting much re- 
quired encoding parameters from a vertical blanking pe- 
riod of the base-band video signal and little required en- 
coding parameters from a horizontal blanking period of 
the base-band video signal, and re-encoding means for 
re-encoding the base-band video signal by referring to 
the much required encoding parameters and the little 
required encoding parameters. 

[0032] According to a seventeenth aspect of the 
present invention ; there is provided an encoding method 
adopted in an encoding apparatus for encoding a base- 
band video signal, the encoding method including the 
steps of extracting much required encoding parameters 
from a vertical blanking period of the base-band video 
signal and little required encoding parameters from a 
horizontal blanking period of the base-band video sig- 
nal, and re-encoding the base-band video signal by re- 
ferring to the much required encoding parameters and 
the little required encoding parameters. 
[0033] According to an eighteenth aspect, of the 
present invention, there is provided an encoding appa- 
ratus for encoding a base-band video signal, the encod- 
ing apparatus including extraction means for extracting 
encoding parameters of picture and higher layers from 
a vertical blanking period of the base-band video signal 
and encoding parameters of slice and lower layers from 
a horizontal blanking period of the base-band video sig- 
nal, and re-encoding means for re-encoding the base- 
131 RSFv'ic^ iTTI^ataWef* 
ters of picture and higher layers and the encoding pa- 
rameters of slice and lower layers. 
[0034] According to a nineteenth aspect of the 
present invention, there is provided an encoding method 
adopted in an encoding apparatus for encoding a base- 
band video signal, the encoding method including the 
steps of extracting encoding parameters of picture and 
higher layers from a vertical blanking period of the base- 
band video signal and encoding parameters of slice and 
lower layers from a horizontal blanking period of the 
base-band video signal , and re-encoding the base-band 
video signal by referring to the encoding parameters of 
picture and higher layers and the encoding parameters 
of slice and lower layers. 

[0035] According to a twentieth aspect of the present 
invention, there is provided an encoding apparatus for 
encoding a base-band video signal, the encoding appa- 
ratus including extraction means for extracting general 
encoding parameters from a vertical blanking period of 
the base-band video signal and detailed encoding pa- 
rameters from a horizontal blanking period of the base- 
band video signal, and re-encoding means for re-encod- 
ing the base-band video signal by referring to the gen- 
eral encoding parameters and the detailed encoding pa- 



rameters. 

[0036] According to a twenty-first aspect of the 
present invention, there is provided an encoding method 
adopted in an encoding apparatus for encoding a base- 

5 band video signal, the encoding method including the 
steps of extracting general encoding parameters from a 
vertical blanking period of the base-band video signal 
and detailed encoding parameters from a horizontal 
blanking period of the base-band video signal, and re- 

10 encoding the base-band video signal by referring to the 
general encoding parameters and the detailed encoding 
parameters. 

[0037] Embodiments of the invention will now be de- 
scribed, by way of example only, with reference to the 
15 accompanying drawings in which: 

Fig. 1 is a block diagram showing a configuration of 
a transcoding system provided by one example em- 
bodiment of the present invention; 

20 Fig. 2 is a block diagram showing a detailed config- 
uration of a video-decoding system employed in the 
transcoding system shown in Fig. 1 ; 
Fig. 3 is a block diagram showing a detailed config- 
uration of a video-encoding system employed in the 

25 transcoding system shown in Fig. 1 ; 

Fig. 4 is a block diagram showing another configu- 
ration of the transcoding system; 
Fig. 5 is a block diagram showing a detailed config- 
uration of a decoder embedded in a decoding ap- 

30 paratus employed in the video-decoding system 
shown in Fig. 2; 

Fig. 6 is an explanatory diagram showing pixels of 
a macroblock; 
-^Fig^is^arnrexplanato^ 

35 v blanking and H blanking; 

Figs. 8A and 8B are explanatory diagrams used for 
describing the position of start_code; 
Fig. 9 is an explanatory diagram used for describing 
a field structure and a frame structure; 

40 Fig. 1 0 is an explanatory diagram used for describ- 
ing the position of start_code; 
Fig. 11 is an explanatory diagram used for describ- 
ing an area in which encoding parameters are 
stored; 

45 Fig. 12 is a block diagram showing a detailed con- 
figuration of an encoder embedded in an encoding 
apparatus employed in the video-encoding system 
shown in Fig. 3; 

Fig. 13 is a diagram showing a grand system em- 
50 ploying a plurality of transcoding systems each 
shown in Fig. 4; 

Fig. 1 4 is a block diagram showing the configuration 
of a tightly coupled transcoding system; 
Fig. 1 5 is an explanatory diagram used for describ- 
es in g the syntax of the stream of a video sequence; 

Fig. 1 6 is an explanatory diagram used for describ- 
ing the configuration of the syntax shown in Fig. 15; 
Fig. 1 7 is an explanatory diagram used for describ- 
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ing the syntax of history_stream ( ) for recording his- 
tory information with a fixed length; 
Fig. 1 8 is an explanatory diagram used for describ- 
ing the syntax of history_stream ( ) for recording his- 
tory information with a fixed length; 
Fig. 1 9 is an explanatory diagram used for describ- 
ing the syntax of history _stream ( ) for recording his- 
tory information with a fixed length; 
Fig. 20 is an explanatory diagram used for describ- 
ing the syntax of history_stream ( ) for recording his- 
tory information with a fixed length; 
Fig. 21 is an explanatory diagram used for describ- 
ing the syntax of history_stream ( ) for recording his- 
tory information with a fixed length; 
Fig. 22 is an explanatory diagram used for describ- 
ing the syntax of history_stream ( ) for recording his- 
tory information with a fixed length; 
Fig. 23 is an explanatory diagram used for describ- 
ing the syntax of history _st ream ( ) for recording his- 
tory information with a fixed length; 
Fig. 24 is an explanatory diagram used for describ- 
ing the syntax of history _st ream ( ) for recording his- 
tory information with a variable length; 
Fig. 25 is an explanatory diagram used for describ- 
ing the syntax of sequence_header ( ); 
Fig. 26 is an explanatory diagram used for describ- 
ing the syntax of sequence_extension ( ); 
Fig. 27 is an explanatory diagram used for describ- 
ing the syntax of extension_and_user_data ( ); 
Fig. 28 is an explanatory diagram used for describ- 
ing the syntax of user_data ( ); 
Fig. 29 is an explanatory diagram used for describ- 
ing the syntax of group_of picture_header ( ); 
Fig. 30 is an explanatory diagram used for describ- 
ing the syntax of picture_header ( ); 
Fig. 31 is an explanatory diagram used for describ- 
ing the syntax of picture_coding_extension ( ); 
Fig. 32 is an explanatory diagram used for describ- 
ing the syntax of extension data ( ); 
Fig. 33 is an explanatory diagram used for describ- 
ing the syntax of quant_matrix_extension ( ); 
Fig. 34 is an explanatory diagram used for describ- 
ing the syntax of copyright_extension ( ); 
Fig. 35 is an explanatory diagram used for describ- 
ing the syntax of picture_display_extension ( ); 
Fig. 36 is an explanatory diagram used for describ- 
ing the syntax of picture_data ( ) ; 
Fig. 37 is an explanatory diagram used for describ- 
ing the syntax of slice ( ); 

Fig. 38 is an explanatory diagram used for describ- 
ing the syntax of macroblock ( ); 
Fig. 39 is an explanatory diagram used for describ- 
ing the syntax of macroblock_modes ( ); 
Fig. 40 is an explanatory diagram used for describ- 
ing the syntax of motion„vectors (s); 
Fig. 41 is an explanatory diagram used for describ- 
ing the syntax of motion_vector (r, s) : 
Fig. 42 is an explanatory diagram used for describ- 
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ing a variable-length code of macrobtock_type for 
an l-ptcture; 

Fig. 43 is an explanatory diagram used for describ- 
ing a variable-length code of macrobtock_type for a 
5 P-picture; 

Fig. 44 is an explanatory diagram used for describ- 
ing a variable-length code of macroblock_type for a 
B-picture; 

Fig. 45 is a block diagram showing a further config- 
10 uration of the transcoding system; 

Fig. 46 is an explanatory diagram used for describ- 
ing each combination of history-information items: 
Fig. 47 shows a flowchart representing the opera- 
tion of the transcoding system shown in Fig. 45; 
15 Fig. 48 is an explanatory diagram used for describ- 
ing the syntax of re_coding_stream_info ( ); 
Fig. 49 is an explanatory diagram used for describ- 
ing red_bw_flag and red_bw_indtcator; 
Fig. 50 is an explanatory diagram used for describ- 
ing a Re_Coding Information Bus macroblock for- 
mation; 

Fig. 51 is an explanatory diagram used for* describ- 
ing picture rate elements; 

Fig. 52 is an explanatory diagram used.foR describ- 
ing other picture rate elements; v-v&k- 
Fig. 53 is an explanatory diagram used for describ- 
ing further picture rate elements; and r-. ... 
Fig. 54 is an explanatory diagram used for describ- 
ing an area in which a Re_Coding Information Bus 
is recorded. ~ 

[0038] Preferred embodiments of the present inven- 
tion are described by referring to diagrams as follows. 
[0039] Fig. 1 is a block diagram showing a>transcod- 
ing system provided by the present invention. A; video- 
decoding system ^receives a bit stream as aninput and 
decodes the input signal by adoption of a technique ex- 
plained later by referring to Fig. 5. Then, the video-de- 
coding system 1 writes information, if required, into a V 
blanking area and an H blanking area, which will be de- 
scribed later by referring to Fig. 7. Finally the video-de- 
coding system 1 converts the decoded signal into an 
output base-band video signal. A video-encoding sys- 
tem 2 receives the base-band video signal as an input 
45 and fetches information, if required, from the V blanking 
area and the H blanking area. The video-encoding sys- 
tem 2 then encodes the input signal by adoption of a 
technique explained later by referring to Fig. 12 and fi- 
nally converts the encoded signal into an output bit 
so stream. 

[0040] A VTR 3 serving as a video-processing system 
is used for editing the base-band video signal. 
[0041] Fig. 2 is a block diagram showing a detailed 
configuration of the video-decoding system 1 . 
55 [0042] A decoding apparatus 1 1 fetches a video sig- 
nal from an input bit stream and outputs the video signal 
to a history-informal ion-multiplexing apparatus 12. The 
decoding apparatus 1 1 also fetches encoding parame- 
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ters of the immediately preceding generation and sup- 
plies the parameters to the history-information-multi- 
plexing apparatus 12 and a data-classifying apparatus 
13. If this transcoding system is a fourth generation, for 
example, encoding parameters of a third generation are 
obtained. In addition , the decoding apparatus 1 1 outputs 
user data representing a conversion history of previous 
data supplied to the video-decoding system 1 to a his- 
tory-decoding apparatus 14. The user data is thus en- 
coding parameters of generations preceding the imme- 
diately preceding generation. 

[0043] The encoding parameters supplied to the data- 
classifying apparatus 1 3 are classified into encoding pa- 
rameters of picture and higher layers of importance to 
a number of applications, and encoding parameters of 
slice and lower layers of no importance to all applica- 
tions. The former encoding parameters are supplied to 
a format encoder 1 5 whereas the latter encoding param- 
eters are output to a format encoder 1 7. The format en- 
coders 15 and 17 convert the formats of the encoding 
parameters into the format of an auxiliary packet and 
output results of the conversion to a V-blanking insertion 
apparatus 16 and an H blanking insertion apparatus 18 
respectively. 

[0044] The history-decoding apparatus 14 comprises 
a user-data decoder 21 for decoding the user data re- 
ceived from the decoding apparatus 1 1 , a converter 22 
for converting the output of the user-data decoder 21 
and a history VLD (Variable-Length Decoder) 23 for re- 
producing history information from the output of the con- 
verter 22. 

[0045] The user-data decoder 21 decodes user data 
supplied by the decoding apparatus 1 1 , supplying a re- 
sult of the decoding to the converter 22. Details of the 
user data will be described later by referring to Fig. 28. 
At any rate, the user data denoted by user_data ( ) com- 
prises user_data_start_code and user_data. According 
to MPEG specifications, appearance of 23 consecutive 
bits of "0" in user_data is prohibited in order to prevent 
the data from being detected incorrectly as 
user_data_start_code. By the way, history information 
referred to as history_stream ( ) may include 23 or more 
consecutive bits of 0 in its user data area, which is a kind 
of user_data conforming to the MPEG specifications. It 
is thus necessary to process the history information by 
insertion of a bit "1" into the user data area with a pre- 
determined timing so that no 23 or more consecutive 
bits of 0 appear in user_data, converting the history in- 
formation into a stream referred to as 
converted_history_stream ( ) to be described later by re- 
ferring to Fig. 15. The component that carries out this 
conversion from history_stream ( ) into 
converted_history_stream ( ) is a converter 42 em- 
ployed in a history-encoding apparatus 38 of the video- 
encoding system 2 of a previous generation shown in 
Fig. 3. On the other hand, the converter 22 employed in 
the history-decoding apparatus 14 carries out a conver- 
sion process to delete the bit "1 ". This conversion proc- 



ess is opposite to the conversion, which was performed 
by the converter 42 employed in the history-encoding 
apparatus 38 to insert the bit "1 " so as to prevent 23 or 
more consecutive bits of 0 from appearing in the user 

5 data referred to as user_data. 

[0046] The history VLD 23 generates history informa- 
tion from the output of the converter 22 and supplies the 
information to the history-information multiplexing appa- 
ratus 12. In this case, the history information is encoding 

^0 parameters of the first and second generations. 

[0047] To put it in detail, the history-decoding appara- 
tus 14 analyzes the syntax of the received user data to 
find a unique ID referred to as History_Data_ld de- 
scribed in the user data. The History_Data_ld ID is used 

*5 for extracting a stream referred to as 
converted_history_stream ( ). The history-decoding ap- 
paratus 14 is capable of further obtaining a stream re- 
ferred to as history_stream ( ) by removing single mark- 
er bits inserted at predetermined intervals into 

20 converted_history_stream ( ). Then, the history-decod- 
ing apparatus 1 4 analyzes the syntax of history_system 
( ) to obtain the encoding parameters of the first and sec- 
ond generations. 

[0048] Assume that the current processing is a fourth- 

25 generation change. In this case, data change histories 
received by the video-decoding system 1 is encoding 
parameters of the first, second and third generations, 
and the history-information-multiplexing apparatus 12 
multiplexes the encoding parameters of the first, second 

30 and third generations with the base-band video data 
produced as a result of decoding by the decoding appa- 
ratus 1 1 . The mixed data is to be supplied to the video- 
encoding system 2, which will carry out a fourth-gener- 
ation encoding process. 

35 [0049] A signal output by the history-information-mul- 
tiplexing apparatus 12 is supplied to the V-blanking in- 
sertion apparatus 1 6 for inserting encoding parameters 
of picture and higher layers received from the format 
converter 1 5 into a V-blanking area to be described later 

40 by referring to Fig. 7. The output of the V-blanking inser- 
tion apparatus 1 6 is supplied to the H-blanking insertion 
apparatus 1 8 for inserting encoding parameters of slice 
and lower layers received from the format converter 17 
into an H-blanking area to be described later by referring 

45 to Fig. 7. The output of the H-blanking insertion appara- 
tus 1 6 is a base-band video signal supplied to the video- 
encoding system 2. 

[0050] Fig. 3 is a block diagram showing a detailed 
configuration of the video-encoding system 2. 

so [0051] An H-blanking extraction apparatus 31 ex- 
tracts an auxiliary packet superposed on an H-blanking 
area from the input base-band video signal and outputs 
the packet to a format converter 32. The format convert- 
er 32 converts the input format and outputs a packet with 

55 a converted format to a multiplexer 33, By the same to- 
ken, a V-blanking extraction apparatus 34 extracts an 
auxiliary packet superposed on a V-blanking area from 
the input base-band video signal and outputs the packet 
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to a format converter 35. The format converter 35 con- 
verts the input format and outputs a packet with a con- 
verted format to the multiplexer 33. The multiplexer 33 
multiplexes the input signals and outputs a signal ob- 
tained as a result of multiplexing to a parameter-gener- 
ating unit 36. 

[0052] If a packet is missing, the parameter-generat- 
ing unit 36 recovers the lost data by adoption of a tech- 
nique to be described later. by referring to Fig. 8, and 
outputs the corrected data to an encoding apparatus 39. 
[0053] After the auxiliary packets have been extracted 
in the H-blanking extraction apparatus 31 and the V- 
blanking extraction apparatus 34, the data is supplied 
to a history-information-separating apparatus 37, which 
extracts base-band video data from the transmitted da- 
ta. The video data is supplied to the encoding apparatus 
39. The history-information-separating apparatus 37 al- 
so extracts history information of the first to third gener- 
ations from the transmitted data and supplies the infor- 
mation to the encoding apparatus 39 and a history-en- 
coding apparatus 38. 

[0054] A history VLC (Variable Length Coder) 43 em- 
ployed in the history-encoding apparatus 38 converts 
the format of the encoding parameters of the 3 genera- 
tions, namely, the first, second and third generations, 
received from the history-information-separating appa- 
ratus 37 into a format of history information, which can 
have a fixed length shown in Figs. 17 to 23 to be de- 
scribed later or a variable length shown in Fig. 24 to be 
described later. Details of the fixed-length and variable- 
length formats will be explained later. 
[0055] A converter 42 converts the history information 
with a format obtained as a result of conversion by the 
history VLC 43 into a stream referred to as 
converted_history_stream ( ). The conversion in the 
converter 42 is carried out in order to prevent data re- 
ferred to as start_code of user_data ( ) from being de- 
tected incorrectly as described earlier. To put it in detail, 
while 23 or more consecutive bits of 0 may appear in 
the history information, appearance of 23 or more con- 
secutive bits of 0 in user_data is prohibited. Thus, the 
converter 42 must converts the history information by 
insertion of "1" with predetermined timings to comply 
with the prohibition. 

[0056] A user-data formatter 41 adds the 
History_Data_ld ID to converted_history_stream ( ) re- 
ceived from the converter 42 in accordance with a for- 
mat shown in Fig. 15 to be described later. The user- 
data formatter 41 also adds user_data_stream_code to 
converted_history_stream ( ). As a result, user_data 
conforming to the MPEG standard is generated. This 
user_data, which can be inserted into a video stream, 
is then supplied to the encoding apparatus 39. 
[0057] The encoding apparatus 39 encodes the base- 
band video data received from the history- information 
separating apparatus 37, converting the data into a bit 
stream having a GOP structure and a bit rate, which are 
specified by an operator or a host computer. It should 



be noted that the structure of a GOP is modified typically 
by changing the number of pictures included in the GOP, 
the number of P pictures existing between 2 consecutive 
I pictures and the number of B pictures existing between 

5 an I picture and a subsequent P or I picture. 

[0058] In this case, since the base-band video data 
received from the history-information separating appa- 
ratus 37 includes history information of the first to third 
generations superposed thereon, the encoding appara- 

10 tus 39 carries out a re-encoding process of a fourth gen- 
eration by selectively reutilizing these pieces of history 
information so as to reduce the amount of deterioration 
of the picture quality caused by the re-encoding proc- 
ess. 

15 [0059] If only data of picture and higher layers is han- 
dled, all the hardware explained earlier by referring to 
Figs. 2 and 3 is not required. That is to say, the format 
converter 17 and the H-blanking insertion apparatus 18 
can be eliminated from the video-decoding system 1 

20 shown in Fig. 2 whereas the format converter 32 and 
the H-blanking insertion apparatus 31 can be eliminated 
from the video-encoding system 2 shown in-Fig. 3. 
[0060] Assume that data of slice and lower layers is 
handled as frequently as data of picture andhigber lay- 

25 ers is. In this case, a video-decoding system* S^arid-a 
video-encoding system 52, which are shown ";in Fig. 4, 
may be used. As shown in the figure, the video-decoding 
system 51 comprises a decoding apparatus 6*1 , a histo- 
ry-decoding apparatus 62 and a history-information- 

30 multiplexing apparatus 63 whereas the video-encoding 
system 52 comprises a history-information separating 
apparatus 64, a history-encoding apparatus 65 and an 
encoding apparatus 66. 

[0061] The decoding apparatus 61 fetches a video 
35 signal and encoding parameters from an input bit 
stream, supplying the. signal and. the parameters to the 
history-information multiplexing apparatus 63. The de- 
coding apparatus 61 also fetches user data from the in- 
put bit stream, and supplies the data to the history-de- 
40 coding apparatus 62, which decodes the data in the 
same way as the history-decoding apparatus 14. The 
history -decoding apparatus 62 supplies a result of de- 
coding to the history-information multiplexing apparatus 
63. As will be described later by referring to Fig. 7, the 
45 history-information mu Itiplexing apparatus 63 writes the 
encoding parameters into a specified area and supplies 
an output to the history-information-separating appara- 
tus 64. 

[0062] The history-information -separating apparatus 
50 64 extracts base-band video data from data received 
from the history-information multiplexing apparatus 63 
and supplies the video data to the encoding apparatus 
66. The history-information-separating apparatus 64 al- 
so extracts history information of the first, second and 
55 third generations from predetermined locations in the 
data received from the history-information multiplexing 
apparatus 63 and supplies the information to the encod- 
ing apparatus 66 and the history-encoding apparatus 



9 



BNSDOCID: <EP 



1111932A? I > 



17 



EP 1 111 932 A2 



18 



65. The history-encoding apparatus 65 carries out the 
same processing as the history-encoding apparatus 38 
to encode the received history information. A result of 
the encoding process is supplied to the encoding appa- 
ratus 66. The encoding apparatus 66 encodes the re- 5 
ceived data, converting the data into a bit stream having 
a predetermined GOP structure and a predetermined bit 
rate. 

[0063] Fig. 5 is a block diagram showing a detailed 
configuration of a decoder 81 employed in the decoding 10 
apparatus 11 explained earlier by referring to Fig. 2 or 
the decoding apparatus 61 explained earlier by referring 
to Fig. 4. 

[0064] As shown in Fig. 5, the decoder 81 comprises 
a reception buffer 91 for buffering a bit stream supplied '5 
to the decoder 81 , a variable-length decoding circuit 92 
for carrying out a variable-length decoding process on 
the encoded bit stream, an inverse-quantization circuit 

93 for carrying out an inverse-quantization process on 
data obtained as a result of the variable-length decoding 20 
process in accordance with a quantization scale re- 
ceived from the variable-length decoding circuit 92, an 
IDCT (Inverse Discrete Cosine Transformation) circuit 

94 for carrying out an IDCT process on DCT (Discrete 
Cosine Transformation) coefficients completing the in- ! . 25 
verse-quantization process, a processor 95 for carrying 

out a motion compensation process, a frame memory 
96 and a motion-compensating circuit 97. 
[0065] In order to decode the encoded bit stream of 
the immediately preceding generation, which is the third 30 
generation in this case, the variable-length decoding cir- 
cuit 92 extracts encoding parameters described in the 
picture layer, the slice layer and the macroblock layer of 

to Fig. 2, the encoding parameters are supplied also to 35 
the data-classifying apparatus 13 for classifying the en- 
coding parameters into encoding parameters of picture 
and higher layers, and encoding parameters of slice and 
lower layers. 

[0066] For example, encoding parameters of the third 40 
generation extracted by the variable-length decoding 
circuit 92 include picture_coding_type showing a picture 
type, quantiser_scale_code showing a quantization 
scale step size, macroblock_type showing a prediction 
mode, motion_vector showing a motion vector, frame/ 45 
fteld_motion_type showing a frame prediction mode or 
a field prediction mode and dct_type showing a frame 
DCT mode or a field DCT mode. The quantiser_scale_ 
code parameter is supplied to the inverse-quantization 
circuit 93 whereas the picture_coding_type, quantiser_ so 
scale_code, macroblock_type, motion_vector, frame/ 
field_motion_type, dct_type and other parameters are 
supplied to the motion-compensating circuit 97. 
[0067] The variable-length decoding circuit 92 ex- 
tracts not only the above encoding parameters required 55 
for decoding the encoded bit stream of the third gener- 
ation, but also encoding parameters to be transferred to 
a transcoding system of the fifth generation at a later 



stage as history information of the third generation from 
a sequence layer, a GOP layer, a picture layer, a slice 
layer and a macroblock layer of the encoded bit stream 
of the third generation. Of course, the encoding param- 
eters of the third generation including the picture. 
coding_type, quantiser_scale_code, macroblock_type, 
motion_vector, frame/field_motion_type and dct_type 
parameters used in the decoding process of the third 
generation are included in the history information of the 
third generation. The operator or the host computer sets 
information indicating which encoding parameters are 
to be extracted as history information in accordance with 
factors such as a transmission capacity in advance. 
[0068] In addition, the variable-length decoding circuit 
92 extracts user data described in a user-data area on 
a picture layer of the encoded bit stream of the third gen- 
eration, and supplies the user data to the history-decod- 
ing system 14. 

[0069] As described above, the history-decoding ap- 
paratus 14 is a circuit for extracting encoding parame- 
ters of the first generation and encoding parameters of 
the second generation, which are described as history 
information, from user data described on a picture layer 
of the encoded bit stream of the third generation. The 
encoding parameters of the first generation and the en- 
coding parameters of the second generation are encod- 
ing parameters of a generation preceding the immedi- 
ately preceding generation, which is the third generation 
in this case. 

[0070] Moreover, the variabieMength decoding circuit 
92 carries out a variable-length decoding process on da- 
ta received from the reception buffer 91 , and supplies a 
motion vector, a prediction mode, a prediction flag and 
WlSCTllaf to tffie^HBTO 971 a 

quantization scale to the inverse-quantization circuit 93 
and decoded picture data to the inverse-quantization 
circuit 93. 

[0071] The inverse-quantization circuit 93 carries out 
an inverse-quantization process on picture data re- 
ceived from the variable-length decoding circuit 92 in 
accordance with a quantization scale also received from 
the variable-length decoding circuit 92, and supplies da- 
ta obtained as a result of the inverse-quantization proc- 
ess to the IDCT circuit 94. The IDCT circuit 94 carries 
out an inverse discrete cosine transformation process 
on the data, that is, DCT parameters, received from the 
inverse-quantization circuit 93, and supplies picture da- 
ta obtained as a result of the inverse discrete cosine 
transformation process to the processor 95. 
[0072] If the picture data supplied by the IDCT circuit 

94 to the processor 95 is data of an I picture, the proc- 
essor 95 outputs the data to a forward-prediction picture 
unit 96a of the frame memory 96 to be stored therein. 
The stored data will be used in generation of predicted- 
picture data of picture data supplied later to the proces- 
sor 95. The picture data supplied later to the processor 

95 is data of a P or B picture. 

[0073] If the picture data supplied by the IDCT circuit 
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94 to the processor 95 is data of a P picture having pic- 
ture data preceding by 1 frame as predicted-picture data 
as well as data of a forward-prediction mode, picture da- 
ta, that is, data of an I picture preceding by 1 frame is 
read out from the forward-prediction picture unit 96a of 
the frame memory 96 and supplied to the motion-com- 
pensating circuit 97 for carrying out a motion compen- 
sation process corresponding to a motion vector re- 
ceived from the variable-length decoding circuit 92. The 
processor 95 adds picture data, that is, differential data 
received from the IDCT circuit 94, to the output of the 
motion-compensating circuit 97. The result of the addi- 
tion, that is, data of a decoded P picture, is stored in a 
backward-prediction picture unit 96b of the frame mem- 
ory 96. The stored data will be used in generation of pre- 
dicted-picture data of picture data supplied later to the 
processor 95. The picture data supplied later to the proc- 
essor 95 is data of a B or P picture, 
[0074] As described above, even in the case of data 
of a P picture, data of an intra-picture prediction mode 
is not subjected to processing carried out by the proc- 
essor 95 but stored in the backward-prediction picture 
unit 96b as it is as is the case with data of an I picture. 
[0075] If the picture data supplied by the IDCT circuit 
94 to the processor 95 is data of a B picture, a prediction 
mode received from the variable-length decoding circuit 
92 is examined. If the prediction mode is a forward-pre- 
diction mode, picture data of an I picture is read out from 
the forward- predict ion picture unit 96a of the frame 
memory 96. If the prediction mode is a backward-pre- 
diction mode, picture data of a P picture is read out from 
the backward-prediction picture unit 96b of the frame 
memory 96. If the prediction mode is a forward & back- 
ward-prediction mode, picture data of an I picture is read 
out from the forward-prediction picture unit 96a of the 
frame memory 96 and picture data of a P picture is read 
out from the backward-prediction picture unit 96b of the 
frame memory 96. The motion-compensating circuit 97 
then carries out a motion compensation process for a 
motion vector output by the variable-length decoding cir- 
cuit 92 to generate a predicted picture. In case motion 
compensation is not required or in the case of an intra- 
picture prediction mode, however, no predicted picture 
is generated. 

[0076] The processor95 adds the data completing the 
motion compensation process in the motion-compen- 
sating circuit 97 as described above to the output of the 
IDCT circuit 94, and outputs a result of the addition. If 
the result of the addition is data of a B picture, however, 
the result of the addition is not stored in the frame mem- 
ory 96 since a B picture is not used in generation of a 
predicted picture for another picture. In addition, the mo- 
tion-compensating circuit 97 also carries out processing 
to restore a structure, wherein signals of lines of odd 
fields are separated from signals of lines of even fields, 
back to the original structure. 

[0077] After the image of the B picture has been out- 
put, data of a P picture stored in the backward-prediction 



picture unit 96b is read out and then supplied to the proc- 
essor 95 by way of the motion-compensating circuit 97. 
It should be noted, however that no motion compensa- 
tion process is carried out at that time. 

5 [0078] Then, outputs from the decoder 81 are sup- 
plied to the history-information-multiplexing apparatus 
12. To put it concretely, base-band video data output by 
the processor 95 employed in the decoder 81 , encoding 
parameters of the third generation output by the varia- 

10 ble-length decoding circuit 92 employed in the decoder 
81 and encoding parameters of the first and second gen- 
erations output by the history-decoding apparatus 14 
are supplied to the history-information-multiplexing ap- 
paratus 1 2, which then multiplexes the encoding pararn- 

J 5 eters of the first, second and third generations with the 
base-band video data. As will be explained later by re- 
ferring to Fig. 7, the history-information-multiplexing ap- 
paratus 1 2 records the encoding parameters into the H- 
blanking and V-blanking areas, generating output data. 

20 [0079] The following description explains a technique 
to multiplex the encoding parameters of the first, second 
and third generations with the base-band video data by 
referring to Figs. 6 to 11 . 

[0080] Fig. 6 is a diagram showing a macroblock con- 
25 sisting of 16 pixels x 16 pixels as defined^ryth^vTREG *■ 
specifications. In respect of a luminance signal, the 
macroblock consisting of 16 pixels x 16 pixels is com- 
posed of 4 sub-blocks Y[0], Y[1], Y[2] and Y[3], which 
each consist of 8 pixels x 8 pixels. By the same token, 
30 in respect of a chrominance signal, the macroblock con- 
sisting of 16 pixels x 16 pixels is composed.of 4 sub- 
blocks CrfO], Cr[1], Cb[0] and Cb[1], which each consist 
of 8 pixels x 8 pixels. 

[0081 ] As shown in Fig. 7, the V-blanking insertion ap- 

35 paratus 1 6 inserts encoding parameters of picture and 
higher layers of importance to a number of applications 
typically into a V blanking area. On the other hand, the 
H-blanking insertion apparatus 18 inserts encoding pa- 
rameters of slice and lower layers of no importance to 

40 all applications typically into a V blanking area. 

[0082] With respect to correction of a defective packet 
in the parameter-reproducing unit 36 described earlier, 
there is a technique whereby previous data is stored in 
advance, and data corresponding to a position in the de- 

45 fective packet is replenished. In this case, if start_code 
is written into the head of each piece of data without 
regard to delimiters of packets as shown in Fig. 8A, all 
pieces of data must be fetched and searched for 
start_code of the data including the defective packet. In 

so order to solve this problem, in the case of information of 
picture and higher layers included in a V blanking area, 
information of 1 macroblock has each start_code always 
written at the head of a packet so as to terminate each 
piece of data on the delimiter of an auxiliary packet of 1 

55 stripe as shown in Fig. 8B. With this scheme, a defective 
packet can be repaired with ease. 
[0083] In a macroblock explained earlier by referring 
to Fig. 6, information of a band unit used as a resolution 
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in the vertical direction is referred to as a stripe When 
a picture of an interlace format is processed in an 
MPEG2 system, the processing is properly switched 
from a field structure to a frame structure, which are 
shown in Fig. 9, or vice versa. With the field structure, 
a picture is processed in field units. With the frame struc- 
ture, on the other hand, a picture is processed in frame 
units, which each consist of 2 fields. For this reason, in 
the field structure, every 16 lines form a stripe. In the 
frame field, on the other hand, every 8 lines form a stripe. 
[0084] Encoding parameters of slice and lower layers 
forming the corresponding stripe are transmitted by us- 
ing the parameters to fill up the H blanking area of the 
stripe. In this way, when the video data of a stripe is re- 
ceived, the encoding parameters are obtained at the 
same time. It is thus no longer necessary to provide a 
mechanism such as a buffer for adjustment of timings. 
If start_code exists in a payload of a packet, it is always 
described at the head of the packet as shown in Fig. 10 
in order to make a packet defect easy to repair. 
[0085] Fig. 1 1 is a diagram showing a data block used 
for transmitting 1 pixel of the sub-blocks Y[0], Y[1], Y[2], 
Y[3], Cr{0], Cr[1], Cb[0] and Cb[1], which each consist 
of 64 pixels. Thus, in order to transmit data of 1 macrob- 
lock, 64 data blocks each shown in Fig. 11 are required: 
The 2 low-order bits D1 and DO are used for transmis- 
sion of history information. Thus, for video data of each 
macroblock, 1 ,024 (64 data blocks x 1 6 bits/data block) 
bits of history information can be transmitted. 256 bits 
of history information are generated for each genera- 
tion. Accordingly, history information of 4 (-1,024/256) 
preceding generations can be superposed on video da- 
ta of 1 macroblock. In the data block shown in Fig. 11, 
history ThlBrmalion of the fifsCsecoW 
ations is superposed. 

[0086] Fig. 12 is a diagram showing the configuration 
of an encoder 101 , which is employed in the encoding 
apparatus 39 explained earlier by referring to Fig. 3 or 
the encoding apparatus 66 explained earlier by referring 
to Fig. 4, in concrete terms. As shown in Fig. 12, the 
encoder 101 comprises a controller 125, a motion-vec- 
tor-detecting circuit 111, a frame memory 1 1 2, a frame/ 
field-prediction-mode-switching circuit 113, a processor 
114, a frame/field-DCT-mode-switching circuit 115, a 
DCT circuit 116, a quantization circuit 117, a variable- 
length encoding circuit 118, a transmission buffer 119, 
an inverse-quantization circuit 1 20, an inverse-DCT(ID- 
CT) circuit 121, a processor 122, a frame memory 123 
and a motion-compensating circuit 124. 
[0087] The encoder 1 01 also includes a controller 1 25 
for controlling operations and functions of the circuits 
enumerated above. The controller 125 receives an in- 
struction with regard to a GOP structure from the oper- 
ator or the host computer, determining the type of each 
picture so as to comply with the GOP structure. The con- 
troller 1 25 also receives information on a target bit rate 
from the operator or the host computer, controlling the 
quantization circuit 1 1 7 so that the encoder 101 outputs 



data at a bit rate matching the target bit rate specified 
by the operator or the host computer. 
[0088] In addition, the controller 1 25 also receives his- 
tory information of a plurality of generations from the his- 
5 tory-information-separating apparatus 37. These pieces 
of history information are used for carrying out a process 
to encode a reference picture. Details are described as 
follows. 

[0089] ' First of all, the controller 125 forms a judgment 

10 as to whether or not the type of a reference picture de- 
termined from the GOP structure specified by the oper- 
ator or the host computer matches a picture type includ- 
ed in the history information. That is to say, the controller 
1 25 forms a judgment as to whether or not this reference 

15 picture was encoded in the past with the same picture 
type as the picture type specified by the operator or the 
host computer. To put it in detail, the controller 1 25 forms 
a judgment as to whether or not a picture type assigned 
to this reference picture in the encoding process of the 

20 fourth generation matches the picture type of this refer- 
ence picture in the encoding process of the first gener- 
ation, the picture type of this reference picture in the en- 
coding process of the second generation or the picture 
type of-this reference picture in the encoding process of 

25 the third generation. - 

[0090] If the picture type assigned to this reference 
picture in the encoding process of the fourth generation 
does not match the picture type of this reference picture 
in the encoding process of the first-generation, the pic- 

30 ture type of this reference picture in the encoding proc- 
ess of the second generation and the picture type of this 
reference picture in the encoding process of the third 
generation, the controller 1 25 carries out the normal en- 
coding proce*ss7This"i§^ 

35 was not encoded in the encoding process of the first, 
second or third generation with the same picture type 
as the picture type specified by the operator or the host 
computer for encoding process of the fourth generation. 
[0091] If the picture type assigned to this reference 

40 picture in the encoding process of the fourth generation 
matches the picture type of this reference picture in the 
encoding process of the first generation, the picture type 
of this reference picture in the encoding process of the 
second generation or the picture type of this reference 

45 picture in the encoding process of the third generation, 
on the other hand, the controller 125 carries out an en- 
coding process reutilizing parameters. This is because 
this reference picture was encoded in the encoding 
process of the first, second or third generation with the 

50 same picture type as the picture type specified by the 
operator or the host computer for encoding process of 
the fourth generation. 

[0092] First of all, the normal encoding process car- 
ried out by the controller 125 is explained. 
55 [0093] Encoded picture data is supplied to the motion- 
vector-detecting circuit 111 in macroblock units. The 
motion -vector-detecting circuit 111 processes picture 
data of each frame as an I, P or B picture in accordance 
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with a predetermined sequence set in advance. That is 
to say. frame pictures sequentially supplied to the mo- 
tion-vector-detecting circuit 111 are to be processed one 
after another as I, P and B pictures indicated by the pre- 
determined sequence set in advance. 
[0094] Picture data of a frame processed as an I pic- 
ture is transferred from the motion-vector-detecting cir- 
cuit 111 to a forward-source picture unit 112a of the 
frame memory 112 to be stored therein. In the same way, 
picture data of a frame processed as a B picture is trans- 
ferred from the motion -vector-detecting circuit 111 to a 
reference-source picture unit 1 1 2b of the frame memory 
112 to be stored therein. By the same token, picture data 
of a frame processed as a P picture is transferred from 
the motion-vector-detecting circuit 111 to a backward- 
source picture unit 112c of the frame memory 112 to be 
stored therein. 

[0095] At the next timing point a frame to be proc- 
essed as a B or P picture is received, the data of the first 
P picture stored so far in the backward-source picture 
unit 1 1 2c is transferred to the forward-source picture unit 
112a. Atthattime ; the data of the next B picture is stored 
into the reference-raw picture unit 1 12b over the existing 
data, or the data of the next P picture is stored into the 
backward-source picture unit 112c over the existing da- 
ta. These operations are carried out repeatedly. 
[0096] The signal of each picture stored in the frame 
memory 112 is read out back, and the frame/fie Id -pre- 
diction-mode-switching circuit 113 carries out process- 
ing in a frame-prediction mode processing or a field-pre- 
diction mode in accordance with an instruction received 
from the controller 125. 

[0097] That is to say, the motion-vector-detecting cir- 
cuit 1 1 1 detects a prediction error in the frame-prediction 
mode and a prediction error in the field-prediction mode, 
supplying values of the prediction errors to the controller 
1 25 to be used in formation of a judgment as to whether 
to select the frame-prediction mode or the field-predic- 
tion mode. The controller 125 then controls the frame/ 
field-prediction-mode-switching circuit 113 so as to op- 
erate in either the frame-prediction mode or the field- 
prediction mode. 

[0098] In addition, the motion-vector-detecting circuit 
111 also detects prediction errors in the intra-picture pre- 
diction mode, the forward prediction mode, the back- 
ward prediction mode and the forward & backward pre- 
diction mode, supplying the prediction errors to the con- 
troller 1 25 to be used in selection of one of the prediction 
modes. The controller 125 selects the smallest one 
among the prediction errors of the forward prediction 
mode, the backward prediction mode and the forward & 
backward prediction mode as a prediction error of an 
inter-picture prediction mode. The prediction error of an 
inter-picture prediction mode is then compared with the 
prediction error of the intra-picture prediction mode. The 
controller 125 selects the mode for the smaller predic- 
tion error between the prediction error of an inter-picture 
prediction mode and the prediction error of the intra-pic- 
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ture prediction mode as a prediction mode. That is to 
say, if the prediction error of the intra-picture prediction 
mode is smaller the intra-picture prediction mode is se- 
lected. If the prediction error of the inter-picture predic- 

5 tion mode is smaller, on the other hand, the controller 
1 25 sets the forward prediction mode, the backward pre- 
diction mode or the forward & backward prediction 
mode, which corresponds to the smallest one among 
the prediction errors of the forward prediction mode, the 

10 backward prediction mode and the forward & backward 
prediction mode, as a prediction mode. 
[0099] The controller 1 25 then controls the processor 
114 and the motion-compensating circuit 124 so as to 
operate in the selected prediction mode. As a result, da- 

*5 ta of an I picture is supplied to the frame/field-DCT- 
mode-switching circuit 115. 

[0100] To put it in detail, the motion-vector-detecting 
circuit 111 finds a prediction error for the intra-picture 
prediction by computing the absolute value of a differ- 

20 ence between IZAijl and Z'Aijl where notation IX Aijl is 
the absolute value of a sum of signals Aij, notation ZlAijl 
is a sum of the absolute values of signals Aij; and nota- 
tion Aij represents a signal of a macroblock of the refer- 
ence picture. In addition, the motion-vectorfdetecting 

25 circuit 111 finds a prediction error for the foicward'ptredic-. - 
tion by computing SI Aij -Bijl where notation SI Aij -Bijl is; 
a sum of the absolute values of differences Aij;-Bij and 
notation Bij represents a signal of a macroblock of a pre- 
dicted picture. The motion-vector-detecting circuit 111 

30 also finds prediction errors for the backward prediction 
and the forward & backward prediction in the same way 
as the forward prediction except that a predicted picture 
different from the predicted picture of the forward direc- 
tion is used. - * - 

35 [0101] The four prediction errors are supplied to -the 
controller 1 25 to be compared with each other. The con- 
troller 125 determines the smallest one among the four 
prediction errors, and sets a mode corresponding to the 
smallest prediction error as a prediction mode. To be 

40 more specific, if the prediction error of the intra-picture 
prediction is found to be the smallest one among them, 
the intra-picture prediction mode is set. Otherwise, the 
controller 125 determines the smallest one among the 
remaining three prediction errors for the forward predic- 

45 tion, the backward prediction and the forward & back- 
ward prediction, and sets a prediction mode corre- 
sponding to the smallest prediction error. 
[01 02] The frame/field-prediction-mode-switching cir- 
cuit 113 carries out signal processing corresponding to 

50 a prediction mode selected by the controller 125, and 
outputs a result of the processing to the processor 114. 
To put it concretely, if a frame prediction mode is select- 
ed, the frame/field-prediction-mode-switching circuit 
113 carries out signal processing to supply a luminance 

55 signal to the processor 1 1 4 in the same state as the sig- 
nal was input. As for a chrominance signal, the frame/ 
field-prediction-mode-switching circuit 113 carries out 
signal processing so as to allow odd-field lines coexist 
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with even-field lines. If a field frame prediction mode is 
selected, on the other hand, the frame/field -prediction- 
mode-switching circuit 1 1 3 carries out signal processing 
to compose 2 of the 4 luminance blocks of dots of lines 
of typically odd fields and the remaining 2 luminance 5 
blocks of dots of lines of even fields, supplying a result 
of the processing to the processor 11 4. As for a chromi- 
nance signal, the frame/field-prediction-mode-switching 
circuit 1 1 3 carries out signal processing to compose the 
4 upper lines of even-field lines and the 4 lower lines of 10 
even-field lines. 

[0103] In order to select a frame DCT mode or a field 
DCT mode, the frame/field-DCT-mode-switching circuit 
115 converts the format of data of the 4 luminance 
blocks into a signal format of the frame DCT mode and is 
a signal format of the field DCT mode. In the signal for- 
mat of the frame DCT mode, odd-field lines coexist with 
even-field lines. In the signal format of the field DCT 
mode, on the other hand, odd-field lines are separated 
from even-field lines. The signals of both the formats are 20 
supplied to the DCT circuit 1 16, which computes an en- 
coding efficiency for DCT processing with odd-field lines 
coexisting with even-field lines and an encoding efficien- 
cy for DCT processing with odd-field lines separated 
from even-field lines. The DCT circuit 116 supplies the • 25 
computed encoding efficiencies to the controller 125, 
which compares the encoding efficiencies with each 
other to select a DCT mode of the better encoding effi- 
ciency. The controller 1 25 then controls the frame/field- 
DCT-mode-switching circuit 115 to operate in a DCT 30 
mode selected by the controller 125. 
[01 04] Then, the frame/field-DCT-mode-switching cir- 
cuit 115 outputs data with a configuration conforming to 
the selected DCT mode to the OCT circuit 116. The 
frame/field-DCT-mode-switching circuit 115 also out- 35 
puts a DCT flag indicating the selected DCT mode to 
the variable-length encoding circuit 1 1 8 and the motion- 
compensating circuit 124. 

[0105] As is obvious from the above descriptions, the 
data structure of the luminance blocks in the field pre- 40 
diction mode or the frame prediction mode adopted by 
the frame/field-prediction-mode-switching circuit 113 is 
virtually the same as the data structure of the luminance 
blocks of in the field DCT mode or the frame DCT mode 
respectively adopted by the frame/field-DCT-mode- 45 
switching circuit 115. 

[01 06] When the frame prediction mode with odd-field 
lines coexisting with even-field lines is selected in the 
frame/field-prediction-mode-switching circuit 113, it is 
quite within the bounds of possibility that the frame/field- so 
DCT-mode-switching circuit 115 also selects the frame 
DCT mode with odd-field lines coexisting with even-field 
lines. When the field prediction mode with odd-field lines 
separated from even-field lines is selected in the frame/ 
field-prediction-mode-switching circuit 1 1 3, on the other 55 
hand, it is quite within the bounds of possibility that the 
frame/field-DCT-mode-switching circuit 115 also selects 
the field DCT mode with odd-field lines separated from 



even-field lines. 

[0107] However, the frame prediction mode or the 
field prediction mode selected by the frame/field-predic- 
tion-mode-switching circuit 113 does not always coin- 
cide respectively with the frame DCT mode or the field 
DCT mode selected by the frame/field-DCT-mode- 
switching circuit 115 as described above. This is be- 
cause the frame prediction mode or the field prediction 
mode is selected in the frame/field-prediction-mode- 
switching circuit 113 to provide a smallest absolute val- 
ue of a prediction error, while the frame DCT mode or 
the field DCT mode is selected in the frame/field-DCT- 
mode-switching circuit 115 to give a better encoding ef- 
ficiency. 

[0108] Data of an 1 picture produced by the frame/ 
field-DCT-mode-switching circuit 115 is output to the 
DCT circuit 1 1 6, which carries out a DCT process on the 
data to covert the data into DCT coefficients. The DCT 
coefficients are supplied to the quantization circuit 117, 
which quantizes the coefficients at a quantization scale 
corresponding to a buffer accumulation quantity repre- 
senting the amount of data stored in the transmission 
buffer 119. The quantized coefficients are then supplied 
to the variable-length encoding circuit 118. The quanti- 
zation scale- is determined as follows-" - "«■'■ 
[0109] The controller 125 receives a target bit rate 
representing a desired bit rate from the operator or the 
host computer and a signal representing the number of 
bits stored in the transmission buffer 119. The signal 
representing the number of bits stored in the transmis- 
sion buffer 119 is a signal representing the amount of 
data left in the transmission buffer 119. The controller 
125 generates a feedback_q_scate_code signal based 
on the target bit rate and the signal representing the 
number of bits stored in the transmission buffer 1 1 9. The 
feedback_q_scale_code signal is a control signal used 
for controlling the size of the quantization step adopted 
by the quantization circuit 117 in accordance with the 
amount of data left in the transmission buffer 1 1 9 so that 
neither overflow nor underflow occurs in the transmis- 
sion buffer 119 and, in addition, a bit stream is output 
from the transmission buffer 119 at a bit rate equal to 
the target bit rate. 

[0110] To put it concretely, assume for example that 
the number of bits stored in the transmission buffer 119 
becomes too small. In this case, the size of the quanti- 
zation step is reduced to increase the number of bits to 
be generated in a picture encoded next. If the number 
of bits stored in the transmission buffer 119 becomes 
too large, on the other hand, the size of the quantization 
step is increased to reduce the number of bits to be gen- 
erated in a picture encoded next. It should be noted that, 
since the feedback_q_scate_code signal is proportional 
to the size of the quantization step, an increase in 
feedback_q_scate_code results in an increase in quan- 
tization step size while a decrease in feedback_ 
q_scale_code results in a decrease in quantization step 
size. 
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[01 1 1 ] The following description explains a parameter 
reutilization encoding process, which is offered as a 
characteristic of the encoder 101 , by focusing on a dif- 
ference from the normal encoding process described 
earlier. In order to make the parameter reutilization en- 5 
coding process easy to understand, a reference picture 
is assumed to have been encoded as a P picture in the 
encoding process of the first generation, as an I picture 
in the encoding process of the second generation and 
as a B picture in the encoding process of the third gen- 10 
eration. In the encoding process of the fourth generation 
carried out this time, the reference picture must be en- 
coded as a P picture. 

[01 12] In this case, the reference picture must be en- 
coded in the encoding process of the fourth generation '5 
as an assigned P picture, which is the same as the pic- 
ture type of the encoding process of the first generation. 
Thus, the controller 125 does not newly creates encod- 
ing parameters from video data supplied thereto. In- 
stead, the controller 125 carries out an encoding proc- 20 
ess by utilizing the encoding parameters of the first gen- 
eration. Representative encoding parameters reuttlized 
in the encoding process of the fourth generation include 
quantiser_scaie_code showing a quantization scale 
step size, macroblock_type showing a prediction mode, 25 
motion_vector showing a motion vector, frame/ 
field_motion_type showing a frame prediction mode or 
a field prediction mode and dct_type showing a frame 
DCT mode or a field DCT mode. 

[0113] In addition, the controller 125 does not reutilize 30 
all the encoding parameters transmitted as history infor- 
mation . Instead, the controller 1 25 reutilizes only encod- 
ing parameters, the reutilization of which is assumed to 
be desirable. That is to say, encoding parameters, the 
reutilization of which is assumed to be undesirable, are 35 
not used. Thus, it is necessary to create new values of 
the encoding parameters, the reutilization of which is as- 
sumed to be undesirable. 

[01 1 4] In the normal encoding process described ear- 
lier, the motion-vector-detecting circuit 111 detects the 40 
motion vector of the reference picture. In the encoding 
process reutilizing parameters, on the other hand, the 
processing to detect a motion vector (motion_vector) is 
not carried out. Instead, a motion vector (motion_vector) 
received as history information of the first generation is 45 
reuttlized for a reason explained as follows. 
[01 1 5] The base-band video data obtained as a result 
of a process to decode an encoded stream of the third 
generation has experienced at least 3 decoding proc- 
esses and at least 3 encoding processes. Thus, such 50 
base-band video data obviously has a deteriorated pic- 
ture quality in comparison with the original video data. 
An accurate motion vector cannot be detected from vid- 
eo data having a deteriorated picture quality even if an 
attempt to detect a motion vector is made. That is to say, 55 
a motion vector received as history information of the 
first generation obviously has better precision than a 
motion vector detected in the encoding process of the 



fourth generation. In other words, by reutilization of the 
motion vector received as history information of the first 
generation., the encoding process of the fourth genera- 
tion carried out by the controller 125 will not result in a 
deteriorated picture quality. The motion vector 
(motion_vector) received as history information of the 
first generation is supplied to the motion-vector compen- 
sating circuit 124 and the variable-length encoding cir- 
cuit 118 as information on a motion vector of the refer- 
ence picture encoded in the encoding process of the 
fourth generation. 

[0116] In addition, in the normal encoding process, 
the motion-vector-detecting circuit 111 detects a predic- 
tion error in the frame-prediction mode and a prediction 
error in the field-prediction mode, supplying values of 
the prediction errors to the controller 125 to be used in 
formation of a judgment as to whether to select the 
frame-prediction mode or the field-prediction mode. In 
the encoding process by reutilizing parameters, on the 
other hand, the motion-vector-detecting circuit 1 1 1 does 
not detect a prediction error in the frame.-prediction 
mode and a prediction error in the field-prediction mode. 
Instead, the frame/field_motion_type parameter sup- 
plied as history information of the first generation to in- 
dicate the frame-prediction mode or the fieldkprediction 
mode is reuttlized. This is because a prediction error of 
the frame-prediction mode and a prediction error of the 
field-prediction mode detected in the processing of the 
first generation respectively have higher precision than 
a prediction error of the frame -predict ion mode and a 
prediction error of the field-prediction mode detected in 
the processing of the fourth generation. A prediction 
mode selected on the basis of prediction errors having 
higher precision will result in a more optimum encoding 
process. ». 
[0117] To put it concretely, the controller 125 supplies 
a control signal corresponding to the frame/ 
field_motion_type parameter received as history infor- 
mation of the first generation to the frame/field-predic- 
tion-mode-switching circuit 113, which then carries out 
signal processing corresponding to the reutilized frame/ 
field_motion_type parameter. 

[0118] Furthermore, in the normal encoding process, 
the motion-vector-detecting circuit 111 also detects pre- 
diction errors in the intra-picture prediction mode, the 
forward prediction mode, the backward prediction mode 
and the forward & backward prediction mode, supplying 
the prediction errors to the controller 1 25 to be used in 
selection of one of the intra-picture prediction mode, the 
forward prediction mode, the backward prediction mode 
and the forward & backward prediction mode as a pre- 
diction mode, which is also referred to hereafter as a 
prediction direction mode. In the encoding process by 
reutilizing parameters, on the other hand, the motion- 
vector-detecting circuit 1 1 1 does not compute prediction 
errors for each of the prediction direction mode. Instead, 
a prediction direction mode is determined on the basis 
of a macroblock_type parameter received as history in- 
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formation of the first generation. This is because predic- 
tion errors of the prediction direction modes detected in 
the processing of the first generation respectively have 
higher precision than prediction errors of the prediction 
detection modes detected in the processing of the fourth 5 
generation. A direction prediction mode selected on the 
basis of prediction errors having higher precision will re- 
sult in a more efficient encoding process. To put it con- 
cretely, the controller 125 selects a prediction direction 
mode indicated by the macroblockjype parameter in- 10 
eluded in the history information of the first generation, 
and controls the processor 1 1 4 and the motion-compen- 
sating circuit 124 to operate in the selected prediction 
direction mode. 

[0119] In the normal encoding process, in order to se- is 
lect a frame DCT mode or a field DCT mode, the frame/ 
field-DCT-mode-switching circuit 115 converts the for- 
mat of data of the 4 luminance blocks into a signal format 
of the frame DCT mode and a signal format of the field 
DCT mode. The signals of both the formats are supplied 20 
to the DCT circuit 116, which computes encoding effi- 
ciencies of the frame DCT mode and the field DCT 
mode, and compares the computed encoding efficien- 
cies with each other. In the encoding process reutilizing 
parameters, on the other hand, the frame/field- DCT- 25 
mode-switching circuit 115 does not carry out the 
processing to convert the format of data of the 4 lumi- 
nance blocks into both a signal format of the frame DCT 
mode and a signal format of the field DCT mode. In- 
stead, the frame/field-DCT-mode-switching circuit 115 30 
carries out only processing for a DCT mode indicated 
by the dct_type parameter included in the history infor- 
mation of the first generation. To put it concretely, the 
controller 125 reutilizes the dct_type parameter includ- 
ed in the history information of the first generation and 35 
controls the frame/field-DCT-mode-switching circuit 115 
to carry out only processing for a DCT mode indicated 
by the dct_type parameter included in the history infor- 
mation of the first generation. 

[0120] In the normal encoding process, the controller 40 
125 controls the quantization step size of the quantiza- 
tion circuit 1 1 7 on the basis of a target bit rate specified 
by the operator or the host computer and the amount of 
information left in the transmission buffer 119. In the en- 
coding process reutilizing parameters, on the other 
hand, the quantization step size of the quantization cir- 
cuit 117 is controlled on the basis of the target bit rate, 
the amount of information left in the transmission buffer 
1 1 9 and a previous quantization scale included in history 
information. It should be noted that, in the following de- so 
scription, the previous quantization scale included in 
history information is called the history_q_scale_code 
parameter. In a history stream to be described later, the 
quantization scale is referred to as quantiser_ 
scale_code. 55 
[0121] First of all, the controller 125 generates a cur- 
rent quantization scale referred to as feedback_ 
q_scale_code based on the target bit rate and the signal 



representing the number of bits stored in the transmis- 
sion buffer 119. The current quantization scale referred 
to as feedback_q_scale_code is a value for controlling 
the quantization step size of the quantization circuit 1 1 7 
in accordance with the amount of data left in the trans- 
mission buffer 1 1 9 so that neither overflow nor underflow 
occurs in the transmission buffer 119. Then, the control- 
ler 125 compares the value of the current quantization 
scale referred to as feedback_q_scale_code with the 
value of a previous quantization scale referred to as 
history_q_scale_code included in the history stream of 
the first generation to form a judgment as to whether the 
former or the larger is greater. It should be noted that a 
large quantization scale means a large quantization 
step. If the value of the current quantization scale re- 
ferred to as feedback_q_scale_code is found greater 
than the value of the previous quantization scale re- 
ferred to as history_q_scale_code, the controller 125 
supplies the current quantization scale referred to as 
feedback_q_scale_code to the quantization circuit 117. 
If the value of the current quantization scale referred to 
as feedback_q_scale_code is found smaller than the 
value of the previous quantization scale referred to as 
history_q_scale_code, on the other hand, the controller 
125 supplies the previous quantization scale referred to 
as history_q_scale_code to the quantization circuit 11 7. 
[0122] That is to say, the controller 125 selects the 
largest quantization scale code among a plurality of pre- 
vious quantization scales included in the history infor- 
mation and the current quantization scale computed 
from the amount of information left in the transmission 
buffer 119. In other words, the controller 125 controls 
the quantization circuit 11 7 to carry out quantization by 
using the largest quantization step among the quantiza- 
tion steps used in previous encoding processes, that is, 
the encoding processes of the first, second and third 
generations, and the quantization step used in the cur- 
rent encoding process, that is, the encoding process of 
the fourth generation for a reason described as follows. 
[01 23] Assume that the bit rate of a stream generated 
in the encoding process of the third generation is 4 Mbps 
and a target bit rate specified for the encoder 101 car- 
rying out an encoding process of the fourth generation 
is 1 5 Mbps. In this case, the quantization step is actually 
not reduced simply because the target bit rate is higher 
than the bit rate of a stream generated in the immedi- 
ately preceding encoding process. Even if a picture en- 
coded at a large quantization step in a preceding encod- 
ing process is encoded in the current encoding process 
at a reduced quantization step, the quality of this picture 
is not improved. That is to say, an encoding process to 
encode a picture at a quantization step smaller than a 
quantization step used in a preceding encoding process 
merely increases the number of bits but does not im- 
prove the quality of the picture. Thus, by using the larg- 
est quantization step among the quantization steps 
used in previous encoding processes, that is, the en- 
coding processes of the first, second and third genera- 
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tions : and the quantization step used in the current en- 
coding process, that is, the encoding process of the 
fourth generation, it is possible to carry out an encoding 
process with a highest degree of efficiency. 
[0124] Receiving picture data completing a normal 
encoding process oran encoding process reutilizing pa- 
rameters as described above from the quantization cir- 
cuit 117, the variable-length encoding circuit 118 con- 
verts the picture data, which is data of an I picture in this 
case, into a variable-length code such as the Huffman 
code in accordance with a quantization scale also re- 
ceived from the quantization circuit 117, and supplies 
the variable-length code to the transmission buffer 119. 
[0125] In addition, the variable-length encoding circuit 
118 also encodes the quantization scale received from 
the quantization circuit 1 1 7, a prediction mode received 
from the controller 125, a motion vector received from 
the motion-vector-detecting circuit 1 1 1 , a prediction flag 
received from the frame/field-prediction-mode-switch- 
ing circuit 113 and a DCT flag received from the frame/ 
field-DCT-mode-switching circuit 115 in a variable- 
length encoding process. As described earlier, the pre- 
diction mode is a mode showing whether the intra-pic- 
ture prediction, the forward prediction, the backward 
prediction or the forward & backward prediction has 
been set. The prediction flag is a flag indicating whether 
the frame prediction mode or the field prediction mode 
has been set, and the DCT flag is a flag indicating wheth- 
er the frame DCT mode or the field DCT mode has been 
set. 

[0126] The transmission buffer 11 9 is used for tempo- 
rarily storing data supplied thereto and outputs a buffer 
feedback signal to the controller 125, which supplies a 
quantization control signal representing the amount of 
data stored in the buffer 119 to the quantization circuit 
117. When the amount of data left in the transmission 
buffer 119 exceeds an allowable upper limit, the quan- 
tization circuit 117 increases the quantization scale in 
accordance with the quantization control signal received 
from the controller 1 25 in order to decrease the amount 
of quantized data. When the amount of data left in the 
transmission buffer 119 reversely goes below an allow- 
able lower limit, on the other hand, the quantization cir- 
cuit 117 decreases the quantization scale in accordance 
with the quantization control signal received from the 
controller 125 in order to increase the amount of quan- 
tized data. As a result, an overflow and an underflow are 
prevented from occurring in the transmission buffer 1 1 9. 
[01 27] The data stored in the transmission buffer 1 1 9 
is read out with a predetermined timing as an output. 
[01 28] On the other hand, the data of the I picture out- 
put by the quantization circuit 1 1 7 is supplied also to the 
inverse-quantization circuit 120, which then carries out 
an inverse-quantization process at a quantization scale 
received from the quantization circuit 117. The output of 
the inverse-quantization circuit 120 is supplied to an ID- 
CT (Inverse Discrete Cosine Transformation) circuit 
121 , which then carries out an IDCT process thereon. 



The result of the inverse discrete cosine transformation 
process is supplied to the frame memory 1 23 by way of 
the processor 122 to be stored in a forward-prediction 
picture unit 123a of the frame memory 123. 

5 [0129] Assume that the motion-vector-detecting cir- 
cuit 111 processes picture data of frames sequentially 
supplied thereto as pictures having the types of I, B, P, 
B, P. B and so on. In this case, after the picture data of 
the first received frame has been processed as an I pic- 

10 ture and before the data of the. next received frame is 
processed as a B picture, the data of the frame imme- 
diately following the next frame is processed as a P pic- 
ture. This is because, since a B picture necessitates 
backward prediction entailing the following picture, a de- 

*5 coding process cannot be carried out unless the imme- 
diately succeeding P picture to serve as a backward- 
prediction picture is prepared in advance. 
[0130] Thus, after the picture data of the first received 
frame has been processed as an I picture, the motion- 

20 vector-detecting circuit 1 1 1 starts processing of the data 
of the P picture stored in the backward-source picture 
unit 112c. Then, in the same way as the one-described 
before, the motion-vector-detecting circuit 111 supplies 
a sum of the absolute values of prediction errors or a 

25 sum of the absolute values of differences^ between ^ 
frames for macroblocks to the controller 125 for each v 
mode. The frame/field-prediction-mode-switching cir- 
cuit 113 operates in the frame prediction mode or the - 
field prediction mode in accordance with an instruction 

30 received from the controller 125. In addition, the proc- 
essor 114 and the motion-compensating circuit 124 op- 
erate in the intra-picture prediction mode, the 1 forward 
prediction mode : the backward prediction mode or the 
forward & backward prediction mode in accordance with 

35 an instruction issued by the controller 125 as a result of 
comparison of the sums. for the modes received from 
the motion-vector-detecting circuit 111. 
[01 31 ] If the intra-picture prediction mode is selected, 
the processor 114 sets a switch 114d at a contact point 
a. In this case, the data processed by the frame/field- 
prediction-mode-switching circuit 113 is output to a 
transmission line by way of the frame/field-DCT-mode- 
switching circuit 115, the DCT circuit 116, the quantiza- 
tion circuit 117, the variable-length encoding circuit 118 

^5 and the transmission buffer 11 9 as is the case with an I 
picture. The data is also supplied to the frame memory 
123 by way of the inverse-quantization circuit 120, the 
inverse-DCT (IDCT) circuit 121 and the processor 122 
to be stored in the backward-prediction picture unit 1 23b 

50 of the frame memory 123. 

[0132] If the forward prediction mode is selected, the 
processor 114 sets the switch 1 14d at a contact point b, 
and the motion-compensating circuit 1 24 reads out data 
stored in the forward-prediction picture unit 123a of the 

55 frame memory 1 23. The data stored in the forward-pre- 
diction picture unit 123a is data of an I picture in this 
case. The motion-compensating circuit 124 compen- 
sates a motion in accordance with a motion vector out- 
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put by the motion -vector-detecting circuit 111 . That is to 
say, requested by the controller 125 to set the forward 
prediction mode, the motion-compensating circuit 124 
reads out data from the forward-prediction picture unit 
1 23a by shifting the read address from a position corre- 5 
sponding to a location of a macroblock currently being 
output by the motion-vector-detecting circuit 111 by a 
shift distance corresponding to the motion vector also 
output by the motion-vector-detecting circuit 111 to gen- 
erate prediction picture data. 10 
[0133] The prediction picture data generated by the 
motion-compensating circuit 124 is supplied to a proc- 
essor 114a, which then subtracts the prediction picture 
data received from the motion-compensating circuit 1 24 
for a macroblock of a reference picture received from is 
the frame/field-prediction-mode-switching circuit 113 
from the data of the macroblock, and outputs the differ- 
ence as a prediction error. This prediction error or this 
differential data is output to a transmission line by way 
of the frame/field-DCT-mode-switching circuit 115, the 20 
DCT circuit 116, the quantization circuit 117, the varia- 
ble-length encoding circuit 118 and the transmission 
buffer 119. The differential data is also locally decoded 
by the inverse-quantization circuit 120 and the inverse- 
DCT (IDCT) circuit 121 before being supplied to the 25 
processor 122. 

[01 34] The processor 1 22 also receives the prediction 
picture data supplied to the processor 114a. The proc- 
essor 122 adds differential data output by the IDCT cir- 
cuit 121 to the prediction picture data generated by the 30 
motion-compensating circuit 1 24. As a result, data of the 
original (decoded) P picture is obtained. The data of the 
original (decoded) P picture is supplied to the backward- 
prediction picture unit 123b of the frame memory 123. 
[0135] After the data of the I and P pictures has been 35 
stored in the forward-prediction and backward-predic- 
tion picture units 123a and 123b respectively as de- 
scribed above, the motion-vector-detecting circuit 111 
carries out processing on the B picture. To put it in detail, 
the motion-vector-detecting circuit 111 supplies a sum 40 
of the absolute values of prediction errors or a sum of 
the absolute values of differences between frames for 
macroblocks to the controller 125 for each mode. The 
frame/field-prediction-mode-switching circuit 113 oper- 
ates in the frame prediction mode or the field prediction 45 
mode in accordance with an instruction received from 
the controller 125. In addition, the processor 114 and 
the motion-compensating circuit 124 operate in the in- 
tra-picture prediction mode, the forward prediction 
mode, the backward prediction mode or the forward & so 
backward prediction mode in accordance with an in- 
struction issued by the controller 1 25 as a result of com- 
parison of the sums for the modes received from the mo- 
tion-vector-detecting circuit 111. 

[0136] As described above, if the intra-picture predic- 55 
tion mode is selected, the processor 114 sets the switch 
114d at the contact point a. If the forward prediction 
mode is selected., however, the processor 114 sets the 



switch 1 1 4d at the contact point b. At that time, the data 
is transmitted after being processed in the same way as 
a P picture. 

[0137] If the backward or forward & backward predic- 
tion mode is selected : on the other hand, the processor 
114 sets the switch 114d at the contact point c or d re- 
spectively. 

[0138] In the backward prediction mode with the 
switch 114d set at the contact point c, data of a picture 
stored in the backward-prediction picture unit 123b is 
read out by the motion-compensating circuit 124 and 
subjected to a motion compensation process according 
to a motion vector output by the motion-vector-detecting 
circuit 111 in the motion-compensating circuit 124. In 
this case, the picture stored in the backward-prediction 
picture unit 1 23b is a P picture. That is to say, requested 
by the controller 125 to set the backward prediction 
mode, the motion-compensating circuit 124 reads out 
data from the backward-prediction picture unit 123b by 
shifting the read address from a position corresponding 
to a location of a macroblock currently being output by 
the motion-vector-detecting circuit 111 by a shift dis- 
tance corresponding to the motion vector also output by 
the motion-vector-detecting circuit 111 to generate pre- 
diction picture data: 

[0139] The prediction picture data generated by the 
motion-compensating circuit 124 is supplied to a proc- 
essor 114b, which then subtracts the prediction picture 
data received from the motion-compensating circuit 1 24 
from the data of a macroblock of a reference picture re- 
ceived from the frame/field-prediction-mode-switching 
circuit 113, and outputs the difference as differential da- 
ta. This differential data is output to the transmission line 
by way of the frame/field-DCT-mode-switching circuit 
115, the DCT circuit 116, the quantization circuit 117, the 
variable-length encoding circuit 118 and the transmis- 
sion buffer 119. 

[0140] In the forward & backward prediction mode 
with the switch 11 4d set at the contact point d, data of 
a picture stored in the forward- predict ion picture unit 
123a and the data of a picture stored in the backward- 
prediction picture unit 123b are read out by the motion- 
compensating circuit 124 and subjected to a motion 
compensation process according to a motion vector out- 
put by the motion-vector-detecting circuit 11 1 in the mo- 
tion-compensating circuit 124. In this case, the picture 
stored in the forward-prediction picture unit 123a is an 
I picture and the picture stored in the backward-predic- 
tion picture unit 123b is a P picture. 
[0141] That is to say : requested by the controller 125 
to set the forward & backward prediction mode, the mo- 
tion-compensating circuit 124 reads out data from the 
forward-prediction picture unit 1 23a by shifting the read 
address from a position corresponding to a location of 
a macroblock currently being output by the motion-vec- 
tor-detecting circuit 111 by a shift distance correspond- 
ing to a motion vector also output by the motion-vector- 
detecting circuit 111 for the forward prediction picture to 
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generate prediction picture data as well as data from the 
backward -prediction picture unit 123b by shifting the 
read address from the position corresponding to the lo- 
cation of the macroblock currently being output by the 
motion-vector-detecting circuit 111 by a shift distance 
corresponding to another motion vector also output by 
the motion-vector-detecting circuit 111 for the backward 
prediction picture to generate other prediction picture 
data. 

[0142] The pieces of prediction picture data generat- 
ed by the motion-compensating circuit 124 are supplied 
to a processor 114c. which then subtracts an average 
of the pieces of prediction picture data received from the 
motion-compensating circuit 1 24 from the data of a mac- 
roblock of a reference picture received from the motion- 
vector-detecting circuit 111, and outputs the difference 
as differential data. This differential data is output to the 
transmission line by way of the frame/field-DCT-mode- 
switching circuit 1 1 5 S the DCT circuit 1 16, the quantiza- 
tion circuit 117, the variable-length encoding circuit 118 
and the transmission buffer 119. 

[0143] Never used as a prediction picture of another 
picture, a B picture is not stored in the frame memory 
123. 

[0144] It should be noted that the forward -prediction 
picture unit 123a and the backward-prediction picture 
unit 1 23b of the frame memory 1 23 can be implemented 
as 2 memory banks. The frame memory 123 can be 
switched from one memory bank to another when nec- 
essary to select a forward-prediction picture or a back- 
ward-prediction picture stored in one of the banks for a 
desired reference picture. 

[01 45] While the above description is focused on a lu- 
minance block, a chrominance block can be processed 
and transmitted in the same way with the macroblock of 
Fig. 6 used as a unit. It should be noted that, as motion 
vectors in the processing of a chrominance block, a ver- 
tical-direction component and a horizontal-direction 
component each having a magnitude equal to 1/2 the 
motion vector of the corresponding luminance block are 
used. 

[0146] Fig. 13 is a diagram showing a grand system 
of typically an image-editing studio comprising a plural- 
ity of transcoding systems connected to each other in 
series. In a history-information multiplexing apparatus 
63-i employed in the video-decoding system 51 -i where 
i = 1 to N, most recent encoding parameters used by the 
history-information multiplexing apparatus 63-i are re- 
corded into a region for storing least recent encoding 
parameters in an area for storing encoding parameters, 
overwriting the least recent parameters. Thus, as ex- 
plained earlier by referring to Fig. 1 1 , base-band picture 
data includes encoding parameters or generation histo- 
ry information of the 4 most recent generations for the 
same macroblock. 

[0147] In the grand system shown in Fig. 13, the vid- 
eo-decoding system 51 and the video-encoding system 
52 of the transcoding system, which were explained by 



referring to Fig. 4, are employed. It is needless to say, 
however, that in place of the video-decoding system 51 
and the video-encoding system 52, the video-decoding 
system 1 shown in Fig. 2 and the video-encoding system 
5 2 shown in Fig. 3 can also be employed respectively. 
[01 48] As described above, in the transcoding system 
implemented by the embodiment, the video-decoding 
system 1 or 51 on the decoding side is loosely coupled 
: with the video-encoding system 2 or 52 on the encoding 

10 side, and encoding parameters are multiplexed with pic- 
ture data prior to transmission. It should be noted, how- 
ever, that a decoding apparatus can also be directly con- 
nected to an encoding apparatus by tight coupling as 
shown in Fig. 14. 

'5 [0149] To put it in detail, a variable-length decoding 
circuit 92 employed in a decoding apparatus 61 extracts 
encoding parameters of the third generation from a se- 
quence layer, a GOP layer, a picture layer, a slice layer 
and a macroblock layer of an encoded stream of the 

20 third generation, supplying the parameters to a history- 
encoding apparatus 65. At the same time, the variable- 
length decoding circuit 92 supplies a base-band video 
signal with the encoding parameters of the picture and 
higher layers inserted into a V-blanking area-and,the en- 

25 coding parameters of the slice and lower layars.inserte.d. 
into an H-blanking area to a controller 1 25 employed in 
an encoding apparatus 66. The history-encoding appa- 
ratus 65 converts the encoding parameters of the third 
generation received from the variable-lengthrdecoding 

30 circuit 92 into a stream referred to as converted. 
history_stream () ; which can be described in;the user 
data area of the picture layer. This stream referred to as 
converted_history_stream ( ) is then supplied~to a vari- 
able-length encoding circuit 1 1 8 employed in-the encod- 
es jng apparatus 66 as user data. 

[0150] The variable-length decoding circuit -92 also 
extracts user data referred to as user_data including en- 
coding parameters of the first generation and encoding^ 
parameters of the second generation from the user data 

40 area of the picture layer of the encoded stream pertain- 
ing to the third generation, supplying the user data to 
the history-decoding apparatus 62. The history-decod- 
ing apparatus 62 then extracts the encoding parameters 
of the first generation and the encoding parameters of 

45 the second generation from a history stream described 
in the user data area as converted_history_stream ( ), 
supplying the parameters to the controller 125 em- 
ployed in the encoding apparatus 66. 
[0151] The controller 125 employed in the encoding 

50 apparatus 66 controls an encoding process carried out 
by the encoding apparatus 66 in accordance with the 
encoding parameters of the first generation and the en- 
coding parameters of the second generation, which 
were received from the history-decoding apparatus 62, 

55 as well as encoding parameters, which are recorded in 
the V-blanking and H-blanking areas and were received 
from the decoding apparatus 61 . 
[0152] The variable-length encoding circuit 118 em- 
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ployed in the encoding apparatus 66 receives encoding 
parameters included in input data from the decoding ap- 
paratus 61 and user data including the encoding param- 
eters of the third generation from the history-encoding 
apparatus 65. The variable-length encoding circuit 118 5 
records these pieces of user data as history information 
in the user data area of the picture layer of the encoded 
stream pertaining to the fourth generation before out- 
putting them. 

[0153] Fig. 15 is a diagram showing a syntax used for 10 
decoding an MPEG video stream. A decoder decodes 
an MPEG bit stream in accordance with this syntax in 
order to extract a plurality of meaningful data items or 
meaningful data elements from the bit stream. In the 
syntax to be explained below, a function and a condi- '5 
tional statement are each represented by a string of nor- 
mal characters whereas a data element is represented 
by a string of bold characters. A data item is described 
by the Mnemonic representing the name of the data 
item. In some cases, the Mnemonic also indicates the 20 
bit length composing the data item and the type and the 
transmission order of the data item. 
[0154] First of all, functions used in the syntax shown 
in Fig. 15 are explained. 

[0155] A function referred to as next_start_code ( ) is 25 
a function used for searching a bit stream for a start code 
described in the bit stream. In the syntax shown in Fig. 
15, the next_start_code () function is followed by a 
sequence_header ( ) function and a sequence_exten- 
sion ( ) function which are laid out sequentially to indi- 30 
cate that the bit stream includes data elements defined 
by the sequence_header ( ) and sequence__extension 
( ) functions. Thus, a start code, a kind of data element 
described at the beginning of the sequence_header ( ) 
and sequence_extension ( ) functions, is found by the 35 
next_start_code ( ) function from the bit stream in an op- 
eration to decode the bit stream. The start code is then 
used as a reference to further find the sequence_header 
( ) and sequence_extension ( ) functions and decode 
data elements defined by the sequencejieader ( ) and 40 
sequence_extension ( ) functions. 
[0156] It should be noted that the sequence_header 
( ) function is a function used for defining header data 
of a sequence layer in the MPEG bit stream whereas 
the sequence_extension ( ) function is a function used 45 
for defining extension data of a sequence layer in the 
MPEG bit stream. 

[0157] A do { } while statement is described after the 
sequence_extension ( ) function. The do { } while state- 
ment comprises a { } block following a do statement and so 
a while statement following the { } block. Data elements 
described by functions in the { } block following the do 
statement are extracted from the data stream as long 
as a condition defined by the while statement is true. 
That is to say, the do { } while statement defines a de- 55 
coding process to extract data elements described by 
functions in the { } block following the do statement from 
the bit stream as long as the condition defined by the 



while statement is true. 

[01 58] A function referred to as nextbits ( ) used in the 
while statement is a function used to compare a bit or a 
string of bits appearing in the bit stream with a data el- 
ement to be decoded next. In the example of the syntax 
shown in Fig. 15, the nextbits ( ) function compares a 
string of bits appearing in the bit stream with 
sequence_end_code used for indicating the end of a 
video sequence. The condition defined by the while 
statement is to be true if the string of bits appearing in 
the bit stream does not match sequence_end_code. 
Thus, the do { } while statement described after the 
sequence_extension ( ) function indicates that data el- 
ements defined by functions in the { ) block following the 
do statement are described in the bit stream as long as 
sequence_end_code used for indicating the end of a 
video sequence does not appear in the bit stream. 
[0159] After the data elements defined by the 
sequence_extension ( ) function in the bit stream, data 
elements defined by an extension_and_user_data(0) 
function are described. The extension_and_user_data 
(0) function is a function used for defining extension data 
and user data of the sequence layer of the MPEG bit 
stream . 

[0160] A do. {}' while statement following the 
extension_and_user_data(0) function is a function to 
extract data elements described by functions in the { } 
block following the do statement from the bit stream as 
long as a condition defined by the while statement is 
true. The nextbits ( ) functions used in the while state- 
ment are functions used to form a judgment as to wheth- 
er or not a bit or a string of bits appearing in the bit stream 
matches picture_start_code or group_start_code start 
codes respectively by comparing the string with the start 
code specified in the function. If the string of bits appear- 
ing in the bit stream matches picture_start_code or 
group_start_code, a condition defined by the while 
statement is said to be true. Thus, if picture_start_code 
or group_start_code appears in the bit stream, the 
codes of data elements defined by functions in the { } 
block following the do statement are described after this 
start code. Accordingly, by finding a start code repre- 
sented by picture_start_code or group_start_code, it is 
possible to extract data elements defined by functions 
in the { } block of the do statement from the bit stream. 
[0161] An if-statement described at the beginning of 
the { } block of the do statement states a condition "if 
group_start_code appears in the bit stream." A true (sat- 
isfied) condition stated by the if-statement indicates that 
data elements defined by a group_of_picture_header(1 ) 
function and an extension and user data{1 ) function are 
described sequentially after group_start_code. 
[0162] The group_of_picture_header(1) function is a 
function used for defining header data of a GOP layer 
of the MPEG bit stream and the extension_and_ 
user_data(1 ) function is a function used for defining ex- 
tension data named extension_data and/or user data 
named user_data of the GOP layer of the MPEG bit 
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stream. 

[0163] Furthermore, in this bit stream, data elements 
defined by a picture_header ( ) function and a 
picture_coding_.extension ( ) function are described af- 
ter the data elements defined by the group_of_picture_ 5 
header(1) function and the extension and user data(1) 
function. Of course, if the condition defined by the if- 
statement is not true, the data elements defined by the 
group_of_picture_header(1 ) function and the extension 
and user data(1 ) function are not described. In this case, 10 
the data elements defined by the picture_header ( ) 
function and the picture_coding_extension () function 
are described after the data elements defined by an 
extension_and_user_data(0) function. 
[0164] The picture_header ( ) function is a function 15 
used for defining header data to a picture layer of the 
MPEG bit stream and the picture_coding_extension ( ) 
function is a function used for defining first extension 
data of the picture layer of the MPEG bit stream. 
[0165] The next while statement is a function used for 20 
defining a condition. A condition defined by each if- 
statement described in a { } block following the condition 
defined by the while statement is judged to be true or 
false as long as the condition defined by the while state- 
ment is true, nextbits ( ) functions used in the while state- 25 
ment are functions for forming a judgment as to whether 
a string of bits appearing in the bit stream matches 
extension_start_code and user_data_start_code re- 
spectively. If the string of bits appearing in the bit stream 
matches extension_start_code or user_data_start_ 30 
code, a condition defined by the while statement is said 
to be true. 

[01 66] A first if-statement in the { } block following the 
while statement is a function for forming a judgment as 
to whether or not a string of bits appearing in the bit 35 
stream matches extension_start_code. A string of bits 
appearing in the bit stream that matches 32-bit 
extension_start_code indicates that data elements de- 
fined by an extension_data(2) function are described af- 
ter extension_start_code in the bit stream. 40 
[01 67] A second if-statement is a function for forming 
a judgment as to whether or not a string of bits appearing 
in the bit stream matches user_data_start_code. If a 
string of bits appearing in the bit stream matches 32-bit 
user_data_start_code, a condition defined by a third if- 45 
statement is judged to be true or false. The 
user_dala_start_code is a start code used for indicating 
the beginning of a user-data area of the picture layer of 
the MPEG bit stream. 

[0168] The third if-statement in the { } block following so 
the while statement is a function for forming a judgment 
as to whether or not a string of bits appearing in the bit 
stream matches History_Data_ID. A string of bits ap- 
pearing in the bit stream that matches 32-bit 
History_DataJD indicates that data elements defined 55 
by a converted_history_stream ( ) function are de- 
scribed after a code indicated by 32-bit History_Data_lD 
in the user-data area of the picture layer of the MPEG 



bit stream. 

[0169] A converted_history_stream () function is a 
function used for describing history information and his- 
tory data for transmitting all encoding parameters used 
in the MPEG encoding process. Details of data ele- 
ments defined by this converted_history_stream ( ) 
function will be described later as history_stream ( ) by 
referring to Figs. 17 to 24. History_Data_ID is a start 
code used for indicating the beginning of a description 
of the history information and the history data in the us- 
er-data area of the picture layer of the MPEG bit stream. 
[0170] An else statement is syntax indicating a case 
for a false condition defined by the third if-statement. 
Thus, if data elements defined by a converted_history_ 
stream ( ) function are not described in the user-data 
area of the picture layer of the MPEG bit stream, data 
elements defined by a user_data ( ) function are de- 
scribed. 

[0171] According to the syntax shown in Fig. 15, his- 
tory information is described in converted_history_ 
stream ( ) but not in user_data ( ). The stream referred 
to as converted_history_stream ( ) is described as a 
kind of user_data ( ) conforming to the MPEG standard. 
For this reasons, in some cases, this specification ex- 
plains that history information is described iftuseiVjLP'ata. 
In such cases, the explanation means that the history 
information is described as a kind of user_data conform- 
ing to the MPEG standard. 

[0172] A picture_data () function is a function used 
for describing data elements related to a slice, layer and 
a macroblock layer after user data of the picture layer 
of the MPEG bit stream. Normally, data elements de- 
fined by this picture_data ( ) function are described after 
data elements defined by a user_data ( ) function or data 
elements defined by a converted_history_stream ( ) 
function described in -the. user-data area of the picture 
layer of the bit stream. If neither extension_start_code 
nor user_data_start_code exists in a bit stream showing 
data elements of the picture layer, however, data ele- 
ments defined by this picture_data ( ) function are de- 
scribed after data elements defined by a picture_ 
coding_extension ( ) function. 

[0173] Following the data elements defined by this 
picture_data () function, data elements defined by a 
sequence_header () function and a sequence_exten- 
sion ( ) function are described sequentially. The data el- 
ements described by the sequence_header ( ) function 
and the sequence_extension ( ) function are exactly the 
same data elements as defined by a sequence_header 
( ) function and a sequence_extension ( ) function de- 
scribed at the beginning of a sequence of the video 
stream. The reason why the same pieces of data are 
defined in the stream is to prevent data of the sequence 
layer from being no longer receivable, thus, preventing 
a stream from being no longer decodable when recep- 
tion of a bit stream is started by a bit stream receiving 
apparatus in the middle of a data stream, such as part 
of bit stream corresponding to a picture layer. 
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[0174] Following the data elements defined by the 
sequence_header ( ) function and the sequence__exten- 
sion ( ) function, that is ; at the end of the data stream, 
32-bit sequence_end„code used for indicating the end 
of the sequence is described. 5 
[0175] Fig. 1 6 is a schematic diagram showing an out- 
line of the basic configuration of the syntax described 
so far. 

[01 76] Next, a history stream defined by a converted. ' 
history_stream ( ) function is explained. 10 
[0177] The converted_history_stream ( ) function is a 
function used for inserting a history stream showing his- 
tory information into the user-data area of the MPEG pic- 
ture layer. It should be noted that the word 'converted' 
means that the stream has completed a conversion f5 
process to insert one marker bit for at least every 22 bits 
of the history stream composed of history data to be in- 
serted into the user area in order to avoid start emula- 
tion. 

[0178] The converted_history_stream () function is 20 
described in either one of a format of a fixed-length his- 
tory stream shown in Figs. 1 7 to 23 or a variable-length 
history stream shown in Fig. 24 to be described later. If 
the fixed-length history stream is selected on the encod- 
er side, there is a merit that a circuit and software em- 25 
ployed in the decoder for decoding data elements from 
the history stream become.simple. If the variable-length 
history stream is selected on the encoder side, on the 
other hand, the encoder is capable of selecting arbitrar- 
ily history information or data elements described in the 30 
user area of the picture layer when necessary. Thus, the 
amount of data of the history stream can be reduced. 
As a result, the data rate of the bit stream encoded as 
a whole can also be lowered as well, 

[0179] The history stream, the history information, the 35 
history data and the history parameter cited in the ex- 
planation of the present invention are encoding param- 
eters or data elements used in the related art encoding 
processes and are not encoding-parameter data used 
in the current encoding process or the encoding process 40 
carried out at the last stage. Consider a case in which 
a picture is encoded and transmitted as an I picture in 
an encoding process of a first generation, as a P picture 
in an encoding process of a second generation and as 
a B picture in an encoding process of a third generation. 45 
[0180] Encoding parameters used in the encoding 
process of the third generation are described at prede- 
termined locations of the sequence, GOP, slice and 
macroblock layers of an encoded bit stream generated 
as a result of the encoding process of the third genera- so 
tion. On the other hand, encoding parameters used in 
the encoding process of the first and second genera- 
tions are not recorded in the sequence or GOP layer for 
recording the encoding parameters used in the encod- 
ing process of the third generation, but recorded in the 55 
user-data area of the picture layer as history information 
of the encoding parameters in accordance with the syn- 
tax described above. 



[01 81 ] First of all, the syntax of the fixed-length history 
stream is explained by referring to Figs. 17 to 23. 
[0182] In the first place, encoding parameters related 
to the sequence header of the sequence layer used in 
the previous encoding processes, that is, the encoding 
processes of typically the first and second generations, 
are inserted as a history stream into the user-data area 
of the picture layer of the bit stream generated in the 
encoding process carried out at the last stage, that is, 
the encoding process of typically the third generation. It 
should be noted that history information related to the 
sequence header of the sequence layer of the bit stream 
generated in the previous encoding processes is never 
inserted into the sequence header of the sequence layer 
of the bit stream generated in the encoding process car- 
ried out at the last stage. 

[01 83] Data elements related to the sequence header 
(sequence_header) used in the previous encoding proc- 
esses include sequence_header_code, sequence^ 
head er_present_f lag, horizontaLsize_value, marker_ 
bit, verticaLsize_value ; aspect_ratio_information, 
frame_rate_code, bit_rate_value, vbv_buffer_ 
size_value, constrained_parameter_flag, load_intra_ 
quantizer_matrix, intra_quantizer_matrix, load_non_ 
intra_quantizer_matrix and non_intra_quantizer__matrix 
as shown in Fig. 17. 

[0184] The data elements listed above are described 
as follows. The sequence_header_code data element 
is a-start synchronization code of the sequence layer. 
The sequence_header_present_flag data element is a 
flag used for indicating whether data in the sequence 
header is valid or invalid. The horizontal_size_value da- 
ta element is data comprising the low-order 12 bits of 
the number of pixels of the picture in the horizontal di- 
rection. The marker_bit data element is bit data inserted 
for preventing start-code emulation. The vertical. 
size_value data element is data comprising low-order 
12 bits of the number of pixels of the picture in the ver- 
tical direction. The aspect_ratio_information data ele- 
ment is an aspect ratio, that is, a ratio of the height to 
the width of the picture, or the aspect ratio of the display 
screen. The frame_rate_code data element is data rep- 
resenting the picture display period. 
[0185] The bit__rate_value data element is data com- 
prising the low-order 1 8 bits of a bit rate for limiting the 
number of generated bits. The data is rounded up in 
400-bsp units. The vbv_buffer_size_value data element 
is data comprising the low-order 10 bits of a value for 
determining the size of a virtual buffer (video buffer ver- 
ifier) used in control of the amount of generated code. 
The constrained_parameter_flag data element is a flag 
used for indicating whether or not parameters are under 
constraint. The load_intra_quantizer_matrix data ele- 
ment is a flag used for indicating whether or not data of 
an intra-MB quantization matrix exists. The 
intra_quantizer_matrix data element is the value of the 
intra-MB quantization matrix. The load_non_intra_ 
quantizer_matrix data element is a flag used for indicat- 
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ing whether or not data of a non-intra-MB quantization 
matrix exists. The non_intra_quantizer_matrix data ele- 
ment is the value of the non-intra-MB quantization ma- 
trix. 

[0186] Subsequently, data elements representing a 5 
sequence extension used in the previous encoding 
processes are described as a history stream in the user- 
data area of the picture layer of the bit stream generated 
in the encoding process carried out at the last stage. 
[0187] Data elements representing the sequence ex- 10 
tension (sequence_extention) used in the previous en- 
coding include extension_start_code, extension_ 
start_code_identifier, 
sequence_extension_present_flag, 

profite_and_level_indication t progressive_sequence, '5 
chroma_format, horizontal_size_extension, vertical^ 
size_extension, bit_rate_extension, vbv_buffer_ 
size_extension, low_delay, frame_rate_extension_n 
and frame_rate_extension_d as shown in Figs, 17 and 
18. 20 
[0188] The data elements listed above are described 
as follows. The extension start_code_data element is a 
start synchronization code of extension data. The 
extension_start_codc_identifier data element is data 
used for indicating which extension data is transmitted. 25 
The sequence_extension_present_flag data element is 
a flag used for indicating whether data in the sequence 
extension is vafid or invalid. The profile_and_level_in- 
dication data element is data specifying a profile and a 
level of the video data. The progressive_sequence data 30 
element is data showing that the video data has been 
obtained from sequential scanning. The chroma_format 
data element is data specifying the color-difference for- 
mat of the video data. 

[0189] The horizontal_size_extension data element is 35 
the two high-order bits data to be added to 
horizontal_size_value of the sequence header. The 
vertical_size_extension data element is the two high-or- 
der bits data to be added to vertical_size_value of the 
sequence header. The bit_rate_extension data element *o 
is the twelve high-order bits data to be added to 
bit_rate_value of the sequence header. The 
vbv_buffer_size_extension data element is the eight 
high-order bits data to be added to vbv_ 
buffer_s:ze_value of the sequence header. The 45 
low_delay data element is data used for indicating that 
a B picture is not included. The frame_rale_extension_n 
data element is data used for obtaining a frame rate in 
conjunction with frame_rate_code of the sequence 
header. The frame_rate_extension_d data element is so 
data used for obtaining a frame rate in conjunction with 
frame_rate_code of the sequence header. 
[0190] Subsequently, data elements representing a 
sequence-display extension of the sequence layer used 
in the previous encoding processes are described as a 55 
history stream in the user area of the picture layer of the 
bit stream. 

[0191] Data elements described as a sequence-dis- 



play extension (sequence_display_extension) are 
extension_start_code t extension_start_code_identifier, 
sequence_display_extension_present_flag ; 
video_format, colour_decription, colour_primaries, 
transfer_characteristics, matrix_coefficients, display_ 
horizontal_size and display_vertical_size as shown in 
Fig. 18. 

[0192] The data elements listed above are described 
as follows. The extension_start_code data element is a 
start synchronization code of extension data. The 
extension_start_code_identifier data element is data 
used for indicating which extension data is transmitted. 
The sequence_display_extension_present_flag data 
element is a flag used for indicating whether data ele- 
ments in the sequence display extension are valid or 
invalid. The video_format data element is data repre- 
senting the video format of the source signal. The 
colour_description data element is data used for indicat- 
ing that detailed data of a color space exists. The 
colour_primaries data element is data showing details 
of a color characteristic of the source signal. The 
transfer_characteristics data element is data showing 
details of how opto-electrical conversion has been car- 
ried out. The matrix_coefficients data element-is data 
showing details of how a source signal has^beerucon-: 
verted from the three primary colors of light. The 
display_horizontal_size data element is data represent- 
ing the activation area or the horizontal size of an in- 
tended display. The display_vertical_size data element 
is data representing the activation area or the vertical 
size of the intended display. 

[0193] Subsequently, macroblock assignment data 
(named macroblock_assignment_in_user_data) show- 
ing phase information of a macroblock generated in the 
previous encoding processes is described as a history 
stream in the user area of the picture layer of a bit stream 
generated in the encoding process carried out at the last 
stage, 

[0194] The macroblock_assignment_in_user_data 
showing phase information of a macroblock comprises 
data elements such as macroblock_assignment_ 
present_flag, v_phase and h_phase as shown in Fig. 
18. 

[0195] The data elements listed above are described 
as follows. The macroblock_assignment_present_flag 
data element is a flag used for indicating whether data 
elements of macroblock_assignment_in_user_data are 
valid or invalid. The v_phase data element is data show- 
ing phase information in the vertical direction which is 
obtained when the. macroblock is detached from picture 
data. The h_phase data element is data showing phase 
information in the horizontal direction which is obtained 
when the macroblock is detached from picture data. 
[0196] Subsequently, data elements representing a 
GOP header of the GOP layer used in the previous en- 
coding processes are described as a history stream in 
the user area of the picture layer of a bit stream gener- 
ated in the encoding process carried out at the last 
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stage. 

[0197] The data elements representing the GOP 
header (group_of_picture_ header) are group_start_ 
code. group_of_picture_header_present_flag, time_ 
code. closed_gop and broken link as shown in Fig. 18. 5 
[0198] The data elements listed above are described 
as follows. The group_start_code data element is the 
start synchronization code of the GOP layer. The 
group_of_picture_header_present_flag data element is 
a flag used for indicating whether data elements in 10 
group_of_picture_header are valid or invalid. The 
time__code data element is a time code showing the 
length of time measured from the beginning of the first 
picture of the GOP. The closed_gop data element is a 
flag used for indicating whether or not it is possible to 15 
carry out an independent playback operation of a picture 
in one GOP from another GOP. The brokenjink data 
element is a flag used for indicating whether or not the 
B picture at the beginning of the GOP can not be repro- 
duced with a high degree of accuracy because of rea- 20 
sons such as editing. 

[0199] Subsequently, data elements representing a 
picture header of the picture layer used in the previous 
encoding processes are described as a history stream 
in the user area of the picture layer of a bit stream gen- 25 
erated in the encoding process carried out at the last 
stage. 

[0200] The data elements related to a picture header 
(picture_header) are picture_start_code, temporal_ref- 
e re nee, picture_coding_type, vbv_delay, full_pel_ 30 
forward_vector f forward_f_code, full_pel backward vec- 
tor and backward_f_code as shown in Figs. 18 and 1 9. 
[0201] The data elements listed above are described 
concretely as f^ 

ment is the start synchronization code of the picture lay- 35 
er. The temporal_reference data element is a number 
used for indicating a display order of the picture. This 
number is reset at the beginning of the GOP. The 
picture_coding_type data element is data used for indi- 
cating the type of the picture. The vbv_delay data ele- 40 
ment is data showing an initial state of a virtual buffer at 
a random access. The full_pel_forward_vector data el- 
ement is a flag used for indicating whether the precision 
of the forward motion vector is expressed in terms of 
pixel units or half-pixel units. The forward_f_code data 45 
element is data representing a forward-motion-vector 
search range. The full_pel_backward_vector data ele- 
ment is a flag used for indicating whether the precision 
of the backward motion vector is expressed in terms of 
pixel units or half -pixel units. The backward_f_code data so 
element is data representing a backward-motion-vector 
search range. 

[0202] Subsequently, data elements representing a 
picture-coding extension of the picture layer used in the 
previous encoding processes are described as a history 55 
stream in the user area of the picture layer of a bit stream 
generated in the encoding process carried out at the last 
stage. 



[0203] The data elements related to the picture-cod- 
ing extension (picture_coding_extension) are 
extension_start_code, extension_start_code_identifier, 
Lcode [0][0], f_ code [0][1], f_code [1] [0], f_code [1][1], 
intra_dc_precision, picture_structure ; top_field_first 
frame_pred_frame_dct, concealment_motion_vectors, 
q_scale_type, intra_vlc_format, alternate_scan, 
repeat_first_field, chroma_42Q_type ( ,progressive_ 
frame, composite_display_flag, vlaxis, field_sequence, 
sub_carrier, burst_amplitude and sub_carrier_phase as 
shown in Fig: 19. 

[0204] The data elements listed above are described 
as follows. The extension_start_code data element is a 
start code used for indicating the start of extension data 
of the picture layer. The extension_start_code_identifier 
data element is a code used for indicating which exten- 
sion data is transmitted. The f_code [0][0] data element 
is data representing a horizontal motion-vector search 
range in the forward direction. The f_code [0][1] data 
element is data representing a vertical motion-vector 
search range in the forward direction. The f_code [1][0] 
data element is data representing a horizontal motion- 
vector search range in the backward direction. The 
f_code [1 ][1 ] data element is data representing a vertical 
motion-vector search range in the backward direction. 
[0205] The intra_dc_precision data element is data 
representing the precision of DC coefficients. The 
picture_structure data element is data used for indicat- 
ing wnetherthe data structure is a frame structure or a 
field structure. In the case of the field structure, the 
picture_structure data element also indicates whether 
the field structure is the high-order field or the low-order 
field. The top_field_first data element is data used for 
in d i cat in g "wrfethe r the f i rst f ield*of J 'a*frame*structuine is 
the high-order field or the low-order field. The 
frame_pred_frarne_dct data element is data used for in- 
dicating that the prediction of frame-mode DCT is car- 
ried out only in the frame-DCT mode in the case of a 
frame structure. The concealment_motion_vectors data 
element is data used for indicating that the intra-mac- 
roblock includes a motion vector for concealing a trans- 
mission error. 

[0206] The q_scale_type data element is data used 
for indicating whether to use a linear quantization scale 
or a non-linear quantization scale. The intra_vlc_format 
data element is data used for indicating whether or not 
another 2-dimensional VLC is used in the intra-macrob- 
lock. The alternate_scan data element is data repre- 
senting selection to use a zigzag scan or an alternate 
scan. The repeat_first_field data element is data used 
in the case of a 2 : 3 pull-down. The chroma_420_type 
data element is data equal to the value of the next 
progressive_frame data element in the case of a 4 : 2 : 
0 signal format or 0 otherwise. The progressive_frame 
data element is data used for indicating whether or not 
this picture has been obtained from sequential scan- 
ning. The composite_display_flag data element is a flag 
used for indicating whether or not the source signal is a 
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composite signal. 

[0207] The v_axis, fielcLsequence, sub__carrter, 
burst_ampiitude and sub_carrier_phase data elements 
are data used in the case of a PAL source signal. 
[0208] Subsequently, a quantization-matrix extension 5 
used in the previous encoding processes is described 
as a history stream in the user area of the picture layer 
of the bit stream generated in the encoding process car- 
ried out at the last stage. 

[0209] Data elements related to the quantization-ma- 10 
trix extension (quant_matrix_extension) are extension_ 
start_code, extension_start_code_identifier. quant_ 
matrix_extension_present_flag, load_intra_quantizer_ 
matrix, intra_quantizer_matrix [64], load_non_ 
intra_quantizer_matrix, non_intra_quantizer_matrix *5 
[64], load_chroma_intra_quantizer_matrix, chroma 
intra_quantizer matrix [64], load_chroma_non 
intra_quantizer_matrix and chroma_non_intra_ 
quantizer_matrix [64] as shown in Fig. 20. 
[0210] The data elements listed above are described so 
as follows. The extension_start_code data element is a 
start code used for indicating the start of the quantiza- 
tion-matrix extension. The extension_start_ 
code_identifier data element is a code used for indicat- 
ing which extension data is transmitted. The 25 
quant_matrix_extension_present_flag data element is a 
flag used for indicating whether data elements of the 
quantization-matrix extension are valid or invalid. The 
loadJntra._quantizer_matrix data element is data used 
for indicating whether or not quantization-matrix data for 30 
an intra-macroblock exists. The intra_quantizer_matrix 
data element is data representing values of a quantiza- 
tion-matrix for an intra-macroblock. 
[0211] The !oad_non_intra_quantizer_matrix data el- 
ement is data used for indicating whether or not quan- 35 
tization-matrix data for a non-intra-macroblock exists. 
The non_intra_quantizer_matrix data element is data 
representing values of a quantization-matrix for a non- 
intra-macroblock. The load_chroma_intra_quantizer_ 
matrix data element is data used for indicating whether 40 
or not quantization-matrix data for a color-difference in- 
tra-macroblock exists. The chroma_intra_ 
quantizer_matrix data element is data representing val- 
ues of a quantization-matrix for a color-difference intra- 
macroblock. The load_chroma_non_intra„quantizer_ 45 
matrix data element is data used for indicating whether 
or not quantization-matrix data for a color-difference 
non-intra-macroblock exists. The chroma_non_ 
intra_quantizer_matrix data element is data represent- 
ing values of a quantization-matrix for a color-difference so 
non-intra-macroblock. 

[0212] Subsequently, a copyright extension used in 
the previous encoding processes is described as a his- 
tory stream in the user area of the picture layer of the 
bit stream generated in the encoding process carried out 55 
at the last stage. 

[0213] Data elements related to the copyright exten- 
sion (copyright_extension) are extension_start_code, 



extension_start_code_identifier, 

copyright_extension_present_flag, copyright_flag, 
copyrighMdentifier originaLo^copy, copyright. 
number_1 ; copy_right_number_2 and copyright_ 
number_3 as shown in Fig. 20. 

[0214] The data elements listed above are described 
as follows. The extension_start_code data element is a 
start code used for indicating the start of the copyright 
extension. The extension_start_code_identifier data el- 
ement is a code used for indicating which extension data 
is transmitted. The copyright_extension_present_flag 
data element is a flag used for indicating whether data 
elements of the copyright extension are valid or invalid. 
The copy right_f lag data element is a flag used for indi- 
cating whether or not a copyright has been given to en- 
coded video data in a range up to the next copyright ex- 
tension or the end of the sequence. 
[0215] The copyright_identifier data element is data 
used for identifying an institution cataloging the copy- 
right specified by the ISO/IEC JTC/SC29. The 
origtnal_or_copy data element is a flag used for indicat- 
ing whether data of the bit stream is original or copied 
data. The copyright_number_1 data element .indicates 
bits 44 to 63 of a copyright_n ambers The 
copyright_number_2 data element indicatesr;bite*22 to 
43 of the copyright number. The copyright_number_3 
data element indicates bits 0 to 21 of the copyright 
number. 

[0216] Subsequently, a picture-display extension 
(picture_display_extension) used in the previous en- 
coding processes is described as a history stream in the 
user area of the picture layer of the bit streamgenerated 
in the encoding process carried out at the last stage. 
[0217] Data elements representing the picture-dis- 
play extension (picture_display_extension) are 
extension_start_code, extension_start_code_identifier, 
picture_display_extension_present_flag, frame_ 
centre_horizontal_offset_1 , frame_centre_vertical_ 
offset_1, frame_centre_horizontaLoffset_2, frame_ 
centre_vertical_offset_2, frame_centre_horizonta!_ 
offset_3 and frame_centre_vertical_offset_3 as shown 
in Fig. 21. 

[0218] The data elements listed above are described 
as follows. The extension_start_code data element is a 
start code used for indicating the start of the picture-dis- 
play extension. The extension_start_code_identifier da- 
ta element is a code used for indicating which extension 
data is transmitted. The picture_display_extension_ 
present_flag data element is a flag used for indicating 
whether data elements of the picture-display extension 
are valid or invalid. The frame_centre_horizontal_offset 
data element is an offset of the display area in the hor- 
izontal direction and the frame_centre_vertical_offset 
data element is an offset of the display area in the ver- 
tical direction. Up to three offset values of horizontal and 
vertical offsets can be defined respectively. 
[021 9] User data is described as a history stream after 
the history information representing the picture-display 
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extension already explained in the user area of the pic- 
ture layer of the bit stream generated in the encoding 
process carried out at the last stage as shown in Fig. 21 . 
[0220] Following the user data, information on a mac- 
roblock used in the previous encoding processes is de- 
scribed as a history stream as shown in Figs. 21 to 23. 
[0221 ] Information on the macroblock comprises data 
elements related to the position of the macroblock, data 
elements related to the mode of the macroblock, data 
elements related to control of the quantization step, data 
elements related to motion compensation, data ele- 
ments related to the pattern of the macroblock and data 
elements related to the amount of generated code. The 
data elements related to the position of the macroblock 
include such as macroblock_address_h, macroblock^ 
address_v, slice_header_present_flag and skipped, 
m aero block_f lag. The data elements related to the 
mode of the macroblock include such as 
macrobtock_quant, macroblock_motion_forward, 
macroblock_motion_backward, macroblock_pattern, 
macroblock intra, spatial_temporaLweight_code_flag, 
frame_jnotion_type and dct_type. The data elements 
related to control of the quantization step includes such 
as quantiser_sca(e_codc. The data elements related to 
motion compensation include PMV [0][0][0], PMV [0][0] 
[1], motion_yertical_field_select [0][0], PMV {0][1][0], 
PMV [0][1][1], motion_verticaLfield_select [0][1], PMV 
[1][0][0], PMV [1][0][1], motion_verticaLfield_select [1] 
[OJ, PMV [1] [1] [0], PMV [1] [1] [1] and 
motion_vertical_field_select [1] [1]. The data elements 
related to the pattern of the macroblock include such as 
coded_block_pattern, and the data elements related to 
the amount of generated code are nunr^mv^bits, 
niTm^o&Pte ***** 
[0222] The data elements related to the macroblock 
are described in detail as follows. 
[0223] The macroblock_address_h data element is 
data defining the present absolute position of the mac- 
roblock in horizontal direction. The macroblock_ 
address_v data element is data defining the present ab- 
solute position of the macroblock in vertical direction. 
The slice_header_present_flag data element is a flag 
used for indicating this macroblock is located at the be- 
ginning of a slice layer, and whether or not being accom- 
panied by a slice header The skipped_macroblock_f lag 
data element is a flag used for indicating whether or not 
to skip this macroblock in a decoding process. 
[0224] The macroblock_quant data element is data 
derived from macrobIock_type shown in Figs. 38 and 
39. This data element indicates whether or not 
quantiser_scale_code appears in the bit stream. The 
macroblock_motion_forward data element is data de- 
rived from the macroblock_type shown in Figs. 38 and 
39 and used in the decoding process. The 
macroblock_motion_backward data element is data de- 
rived from the macroblockjype shown in Figs. 38 and 
39 and used in the decoding process. The macroblock 
pattern data element is data derived from the 



macroblock_type shown in Figs. 38 and 39 and it indi- 
cates whether or not coded_btock_pattern appears in 
the bit stream. 

[0225] The macroblockjntra data element is data de- 

5 rived from the macroblock_type shown in Figs. 38 and 
39 and used in the decoding process. The 
spatiaLtemporal_weight_code_flag data element is a 
flag derived from the macrobloc_type shown in Figs. 38 
and 39 and used for indicating whether or not 

10 spatial_temporal_weight_code showing an up-sam- 
pling technique of a low-order layer picture with time 
scalability exists in the bit stream. 
[0226] The frame_motion_type data element is a 2-bit 
code used for indicating the prediction type of the mac- 

15 roblock of a frame. A frame_motion_type value of "00" 
indicates that there are two prediction vectors and the 
prediction type is a field-based prediction type. A 
frame_motion_type value of "01" indicates that there is 
one prediction vector and the prediction type is a field- 

20 based prediction type. A frame_motion_type value of 
"1 0" indicates that there is one prediction vector and the 
prediction type is a frame-based prediction type. A 
frame_motion_type value of "11" indicates that there is 
one prediction vector and the prediction type is a duat- 

25 prime prediction* type. The fieldimotion_type data ele- 
ment is a 2-bit code showing the motion prediction of 
the macroblock of a field. A field_motion_type value of 
"01" indicates that there is one prediction vector and the 
prediction type is a field-based prediction type. A 

30 field_motion_type value of "1 0" indicates that there is 
two prediction vectors and the prediction type is an 18 
x 8 macroblock-based prediction type. A field_motion_ 
type value of "11" indicates that there is one prediction 

35 type. The dct_type data element is data used for indi- 
cating whether the DCT is carried out in the frame-DCT 
mode or the field-DCT mode. The quantiser_scale_ 
code data element indicates the quantization-step size 
of the macroblock. 

40 [0227] Next, data elements related to a motion vector 
are described. In order to reduce the magnitude of a mo- 
tion vector required in a decoding process, a particular 
motion vector is subjected to an encoding process by 
actually encoding a difference between the particular 

45 motion vector and a motion vector decoded earlier. A 
decoder for decoding a motion vector has to sustain four 
motion-vector prediction values, each of which compris- 
es horizontal and vertical components. These motion- 
vector prediction values are represented by PMV [r][s] 

50 M ~T ne subscript [r] is a flag used for indicating whether 
the motion vector in a macroblock is the first or second 
vector. To be more specific, an [r] value of "0" indicates 
the first vector and an [r] value of "1 M indicates the sec- 
ond vector. The subscript [s] is a flag used for indicating 

55 whether the direction of the motion vector in the mac- 
roblock is the forward or backward direction. To be more 
specific, an [s] value of "0" indicates the forward direc- 
tion of the motion vector and an [r] value of "1 " indicates 
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the backward direction of the motion vector. The sub- 
script [v] is a fiag used for indicating whether the com- 
ponent of the motion vector in the macroblock is a com- 
ponent in the horizontal or vertical direction. To be more 
specific, a fv] value of "0" indicates the horizontal com- 
ponent of the motion vector and a [v] value of "1" indi- 
cates the vertical component of the motion vector. 
[0228] Thus, PMV [0][0][0] is data representing the 
horizontal component, the forward motion vector of the 
first vector. PMV [0] [0] [1] is data representing the ver- 
tical component of the forward motion vector of the first 
vector. PMV [0][1][0] is data representing the horizontal 
component of the backward motion vector of the first 
vector. PMV [0][1][1] is data representing the vertical 
component of the backward motion vector of the first 
vector. PMV [1 ] [0] [0] is data representing the horizontal 
component of the forward motion vector of the second 
vector. PMV [1][0][1] is data representing the vertical 
component of the forward motion vector of the second 
vector. PMV [1][1][0] is data representing the horizontal 
component of the backward motion vector of the second 
vector. PMV [1][1][1] is data representing the vertical 
component of the backward motion vector of the second 
vector. 

[0229] Data referred to as motion_vertical_ 
field_select [r][s] is data used for indicating which refer- 
enced field of the prediction format is used. To be more 
specific, a motion_vertical_field_select [r][s]-value of "0" 
indicates the top referenced field and a motion_ 
verticaUield_select [r][s]-value of "1" indicates the bot- 
tom referenced field to be used. 

[0230] In motion_vertical_field select [r][s], the sub- 
script [r] is a flag used for indicating whether the motion 
vector in a macroblock is the first or second vector. To 
be more specific, an [r] value of "0" indicates the first 
vector and an [r] value of "1 " indicates the second vector. 
The subscript [s] is a flag used for indicating whether the 
direction of the motion vector in the macroblock is the 
forward or backward direction. To be more specific, an 
[s] value of "0" indicates the forward direction of the mo- 
tion vector and an [s] value of "1 " indicates the backward 
direction of the motion vector. Thus, . motion_ 
vertical_field_select [0J10J indicates the referenced field 
used in the generation of the forward motion vector of 
the first vector. motion_verticaLfield_select [0][1] indi- 
cates the referenced field used in the generation of the 
backward motion vector of the first vector. 
motion_vertical_field_select [1][0] indicates the refer- 
enced field used in the generation of the forward motion 
vector of the second vector, motion_ vertical_fie ld_se- 
lect [1][1] indicates the referenced field used in the gen- 
eration of the backward motion vector of the second vec- 
tor. 

[0231] The coded_biock_pattern data element is var- 
iable-length data used for indicating which DCT block 
among a plurality of DCT blocks each for storing a DCT 
coefficient contains a meaningful or non-zero DCT co- 
efficient. The num_mv_bits data element is data repre- 



senting the amount of code of the motion vector in the 
macroblock. The num_coef_bits data element is data 
representing the amount of code of the DCT coefficient 
in the macroblock. The num_other_bits data element 
5 shown in Fig. 46 is data representing the amount of code 
in the macroblock other than the motion vector and the 
DCT coefficient. 

[0232] Next, a syntax for decoding data elements 
from a history stream with a variable length is explained 

w by referring to Figs. 24 to 44. 

[0233] As shown in Fig. 24, the history stream with a 
variable length comprises data elements defined by a 
next_start_code ( ) function, a sequence_header ( ) 
function, a sequence_exension ( ) function, an 

*5 extension_and_user_data(0) function, a group_of_ 
picture_header () function, an extension_ 
and_user_data(1) function, a picture_header () func- 
tion, a picture_coding_extension ( ) function, a 
re_coding_stream_info () function, an extension_ 

20 and_user_data(2) function and a picture_data ( ) func- 
tion. 

[0234] Since the next_start_code ( ) function is a func- 
tion used for searching a bit stream for a start code, data 
elements defined by the sequence_header, (^> ^function 

25 and used in the previous encoding processesiar-e.de- 
scribed at the beginning of the history stream as shown \ 
in Fig. 25. ^ . •> 

[0235] Data elements defined by the sequence^ 
header () function include sequence_header_code, 

30 sequence__header_present_flag, horizontabsize_val- 
ue, vertical_size_value. aspect_ratio_information, 
frame_rate„code, bit„rate_value, marker_bit, 
vbv_buffer_size_value, constrained_parameter_flag, 
load_intra_q uantizer_matrix , intra_q u antizeF^matrix , 

35 load_non_intra_quantizer„matrix and non_intra_ 
quantizer_matrix as shown in Fig. 25. 
[0236] The data elements listed above are described 
as follows. The sequence_header_code data element 
is the start synchronization code of the sequence layer. 

40 The sequence_header_present_flag data element is a 
flag used for indicating whether data in sequence_ 
header is valid or invalid. The horizontal_size_value da- 
ta element is data comprising the low-order 12 bits of 
the number of pixels of the picture in the horizontal di- 

45 rection. The vertical_size_value data element is data 
comprising the low-order 1 2 bits of the number of pixels 
of the picture in the vertical direction. The 
aspect_ratio_information data element is an aspect ra- 
tio of pixels of a picture, that is, a ratio of the height to 

so the width of the picture ) or the aspect ratio of the display 
screen. The frame_rate_code data element is data rep- 
resenting the picture display period. The bit_rate_value 
data element is data comprising the low-order 1 8 bits of 
a bit rate for limiting the number of generated bits. The 

55 data is rounded up in 400-bsp units. 

[0237] The marker_bit data element is bit data insert- 
ed for preventing start -code emulation. The vbv_ 
buffer_size value data element is data comprising the 
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low-order 10 bits of a value for determining the size of 
a virtual buffer (video buffer verifier) used in control of 
the amount of generated code. The constrained_ 
parameter_f lag data element is a flag used for indicating 
whether or not parameters are under constraint. The 5 
load_intra_quantizer_matrix data element is a flag used 
for indicating whether or not data of an intra-MB quan- 
tization matrix exists. The intra_quantizer_rnatrix data 
element is the value of the intra-MB quantization matrix. 
The load_non_intra_quantizer_matrix data element is a 10 
flag used for indicating whether or not data of a non- 
intra-MB quantization matrix exists. The non_intra_ 
quantizerjmatrix data element is the value of the non- 
intra-MB quantization matrix. 

[0238] Following the data elements defined by the 15 
sequence„header ( ) function , data elements defined by 
the sequence_extension ( ) function are described as a 
history stream as shown in Fig. 26. 
[0239] The data elements defined by the sequence 
extension ( ) function include extension_start_code, 20 
extension_start_code_identifier, 
sequence_extension_present_flag, 
profile_andjevel_jndication, progressive_sequence, 
chroma_format, horizontal_size_extension, verticaL 
size_extension, bit_rate_extension; vbv_buffer_size_ ' 25 
extension, low_delay, frame_rate_extension_n and 
frame_/ate_extension_d as shown in Fig. 26. 
[0240] The data elements listed above are described 
as follows. The extension_start_code data element is a 
start synchronization code of extension data. The 30 
extension_start_code_identifier data element is data 
used for indicating which extension data is transmitted. 
The sequence_extension_present__flag data element is 
a flag used for indicating whether data in the sequence 
extension is valid or invalid. The profile_and_level_ in- 35 
dication data element is data specifying a profile and a 
level of the video data. The progresstve_sequence data 
element is data showing that the video data has been 
obtained from sequential scanning. The chroma_format 
data element is data specifying the color-difference for- 40 
mat of the video data. The horizontal_size_extension 
data element is data to be added to horizontai_ 
size_value of the sequence header as the two high-or- 
der bits. The vertical_size_extension data element is 
data to be added to vertical_size_value of the sequence 45 
header as the two high-order bits. The bit_rate_exten- 
sion data element is data to be added to bit_rate_value 
of the sequence header as the 12 high-order bits. The 
vbv_buffer_size_extension data element is data to be 
added to vbv_buffer_size_yalLie 0 f the sequence head- 50 
er as the 8 high-order bits. 

[0241] The low_deiay data element is data used for 
indicating that a B picture is not included. The 
frarne_rate_extension_n data element is data used for 
obtaining a frame rate in conjunction with frame_ 55 
rate_code of the sequence header. The frame_rate_ 
extension_d data element is data used for obtaining a 
frame rate in conjunction with frame_rate_code of the 



sequence header. 

[0242] Following the data elements defined by the 
sequence_extension ( ) function, data elements defined 
by the extension_and_ user data(O) function are de- 
scribed as a history stream as shown in Fig. 27. For i 
with a value other than 1 , the extension_and_user_data 
(i) function describes only data elements defined by a 
user^data ( ) function as a history stream instead of de- 
scribing data elements defined by the extension_data 
() function. Thus, the extension_and__user_data(0) 
function describes only data elements defined by the 
user_data ( ) function as a history stream. 
[0243] The user_data ( ) function describes user data 
as a history stream on the basis of a syntax like one 
shown in Fig. 28. 

[0244] Following the data elements defined by the 
extension_and_user_data(0) function, data elements 
defined by the group_of_picture_header ( ) function 
shown in Fig. 29 and data elements defined by the 
extension_and_user_data(1) function are described as 
a history stream. It should be noted, however, that the 
data elements defined by the group_of_picture_header 
( ) function and data elements defined by the 
extension_and_user_data(1 ) function are described on- 
ly if group2Start_code representing the start code of the 
GOP layer is described in the history stream. 
[0245] As shown in Fig. 29, the data elements defined 
by the group_of__picture_header () function are 
g ro up_sta rt_cod e , 

group_of_picture_ head er_present_f lag, time_code, 
ciosed_gop and brokenjink. 

[0246] The data elements listed above are described 
as follows. The group_start_code data element is the 
start synchronization code of the GOP layer. The 
group_of_picture_header_presenMlag data element is 
a flag used for indicating whether data elements in 
group_of_picture_header are valid or invalid. The 
time_code data element is a time code showing the 
length of time measured from the beginning of the first 
picture of the GOP. The closed_gop data element is a 
flag used for indicating whether or not it is possible to 
carry out an independent playback operation of a picture 
in the GOP from another GOP. The brokenjink data el- 
ement is a flag used for indicating that the B picture at 
the beginning of the GOP can not be reproduced with a 
high degree of accuracy because of reasons such as 
editing. 

[0247] Much like the extension_and_user_data(0) 
function, the extension_and_user_data(1 ) function de- 
scribes only data elements defined by the user_data ( ) 
function as a history stream. 

[0248] If group_start_codc representing the start 
code of the GOP layer is not described in the history 
stream, the data elements defined by the group_ 
of_picture_header ( ) function and data elements de- 
fined by the extension_and_user_data(1) function are 
also not described in the history stream. In this case, 
data elements defined by the picture_header ( ) function 
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are described after the data elements defined by the 
extension_and_user_data(0) function as a history 
stream. 

[0249] The data elements defined by the 
picture_headr ( ) function are picture_start_code : s 
temporal_reference, picture„coding_type, vbv_delay, 
full_pel_forward_vector, forward_f_code, fuil_pel_ 
backward vector, backward_f_code, extra_bit_picture 
and extra_information_picture as shown in Fig. 30. 
[0250] The data elements listed above are described 10 
concretely as follows. The picture_start_code data ele- 
ment is the start synchronization code of the picture lay- 
er. The temporal_reference data element is a number 
used for indicating a display order of the picture. This 
number is reset at the beginning of the GOP. The is 
picture_coding_type data element is data used for indi- 
cating the type of the picture. The vbv_delay data ele- 
ment is data showing an initial state of a virtual buffer at 
a random access. The fulLpel_forward_vector data el- 
ement is a flag used for indicating whether the precision 20 
of the forward motion vector is expressed in terms of 
integral pixel units or half-pixel units. The forward_f_ 
code data element is data representing a forward-mo- 
tion-vector search range. The full_pel_backward vector 
data element is a flag used for indicating whether the 25 
precision of the backward motion vector is expressed in 
terms of integral pixel units or half-pixel units. The 
backward_f_code data element is data representing a 
backward-mqtion- vector search range. The extra_ 
bit_picture data element is a flag used for indicating 30 
whether or not following additional information exists. To 
be more specific, extra_bit_picture having a value of "0" 
indicates that no following additional information exists 
while extra_bit_picture having a value of "1" indicates 
that following additional information exists. The 35 
extra_information_picture data element is information 
reserved by specifications. 

[0251] Following the data elements defined by the 
picture_headr( ) function, data elements defined by the 
picture_coding_extension ( ) function shown in Fig. 31 .40 
are described as a history stream. 
[0252] The data elements defined by the 
picture_coding_extension ( ) function are extension^ 
start_code, extension_start_code_identifier, f_code[0] 
[0], f_code[0][1] ? f_code[1][0], f_code[1][1], intra_ *s 
dc_prectsion, picture_structure, top_field_first, 
frame_prediclive_frame_dct, concealment_motion_ 
vectors, q_scale_type, intra_vlc_format, alternate^ 
scan, repeat_first_field, chroma_420_type, pro- 
gressive_frame, composite_display_flag, v_axis, so 
field_sequence, sub_carrier, burst_amplitude and 
sub_carrier_phase as shown in Fig. 31. 
[0253] The data elements listed above are described 
as follows. The extension_start_code data element is a 
start code used for indicating the start of extension data ss 
of the picture layer. The extension_start_code_identifier 
data element is a code used for indicating which exten- 
sion data is transmitted. The f_code[0][0] data element 



is data representing a horizontal motion-vector search 
range in the forward direction. The f_code[0][1] data el- 
ement is data representing a vertical motion-vector 
search range in the forward direction. The f_code[1][0] 
data element is data representing a horizontal motion- 
vector search range in the backward direction. The 
f_code[1 ][1 ] data element is data representing a vertical 
motion-vector search range in the backward direction. 
The intra_dc_precision data element is data represent- 
ing the precision of DC coefficients. 
[0254] The picture_structure data element is data 
used for indicating whether the data structure is a frame 
structure or a field structure. In addition, in the case of 
the field structure, the picture_structure data element al- 
so indicates whether the field structure is the high-order 
field or the low-order field. The top_field_first data ele- 
ment is data used for indicating whether the first field of 
a frame structure is the high-order field or the low-order 
field. The frame_predictive_frame_dct data element is 
data used for indicating that the prediction of frame- 
mode DCT is carried out only in the frame mode in the 
case of a frame structure. The concealment_ 
motion_vectors data element is data used for indicating 
that the intra-macroblock includes a motion vector for 
concealing a transmission error. The q_scaleviypedata- 
element is data used for indicating whether to use a Hn-< 
ear quantization scale or a non-linear quantization 
scale. The intra_vlc_format data element is data used 
for indicating whether or not another 2-dimensional VLC 
is used in the intra-macroblock. ^ 
[0255] The alternate_scan data element is;data rep- 
resenting selection to use a zigzag scan or arualternate 
scan. The repeat_first_field data element is data used 
in the case of a 2 : 3 pull-down. The chroma^420_type 
data element is data equal to the value of the next 
progressive Jrame^data element in the case of a 4 : 2 : 
0 signal format or 0 otherwise. The progressive_frame 
data element is data used for indicating whether or not 
this picture has been obtained from sequential scan- 
ning. The composite_display_flag data element is data 
used for indicating whether or not the source signal is a 
composite signal. The v_axis, field_sequence, 
sub_carrier, burst_amplitude and sub_carrier_phase 
data elements are data used in the case of a PAL source 
signal. 

[0256] Following the data elements defined by the 
picture_coding_extension ( ) function, data elements 
defined by the re_coding_stream_info ( ) function are 
described as a history stream. The re_coding_ 
stream_info ( ) function is used mainly for describing a 
combination of pieces of history information. Details of 
the re_coding_stream_info ( ) function will be described 
later by referring to Fig. 48. 

[0257] Following the data elements defined by the 
re_coding_stream_info ( ) function, data elements de- 
fined by the extension_and_user_data(2) function 
shown in Fig. 27 are described as a history stream. It 
should be noted, however, that data elements defined 
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by the extension_data ( ) function are described by the 
extension_and_user__data(2) function only if 
extension_start_code representing the start code of the 
extension exists in the bit stream. In addition, data ele- 
ments defined by the user_data ( ) function are de- 5 
scribed by the extension_and_user_data(2) function af- 
ter the data elements defined by the extension data ( ) 
function.onty if user_data_start_code representing the 
start'code of the user data exists in the bit stream as 
shown in as shown in Fig. 27. That is to say, if neither 10 
the start code of the extension nor the start code of the 
user data exists in the bit stream, data elements defined 
by the extension_data ( ) function and data elements de- 
fined by the user_data ( ) function are not described in 
the bit stream. '5 
[0258] The extension_data ( ) function is a function 
used for describing a data element representing 
extension_start_code and data elements defined by a 
quanl_matrix_extension ( ) function, a copyright_exlen- 
sion ( ) function and a picture_display_extension ( ) 20 
function as a history stream in the bit stream as shown 
in Fig. 32. 

[0259] Data elements defined by the quant_matrix_ 
extension ( ) function are extension_start_codc, 
extension_start_code_identifier, quant_matrix_exten- 25 
sion_present_ftag, load_intra_quantizer_matrix, 
intra_quantizer_matrix[64], load_non_intra_quantizer_ 
matrix, non_intra_quanti2er_matrix[64] J load_chroma_ 
intra_quantizer_matrix, chroma_intra_quantizer_matrix 
[64], load_chroma_non_intra_quantizer_matrix and 30 
chroma_non_intra_quantizer_matrix[64] as shown in 
Fig. 33. 

[0260] The data elements listed above are described 
as follows. The extension_start_code data element is a 
start code used for indicating the start of the quantiza- 35 
tion-matrix extension. The extension_start_code_iden- 
tifier data element is a code used for indicating which 
extension data is transmitted. The quant_ 
matrix_extension_present_flag data element is a flag 
used for indicating whether data elements of the quan- 40 
tization-matrix extension are valid or invalid. The 
load_intra_quantizer_matrix data element is data used 
for indicating whether or not quantization-matrix data for 
an intra-macroblock exists. The intra_quantizer_matrix 
data element is data representing values of a quantiza- 45 
tion-matrix for an intra-macroblock. 
[0261] The load_non_intra_quantizer_matrix data el- 
ement is data used for indicating whether or not quan- 
tization-matrix data for a non-intra-macroblock exists. 
The non_intra_quantizer_matrix data element is data so 
representing values of a quantization-matrix for a non- 
intra-macroblock. The 
load_chroma_intra_quantizer_matrix data element is 
data used for indicating whether or not quantization-ma- 
trix data for a color-difference intra-macroblock exists. 55 
The chroma_intra_quantizer_matrix data element is da- 
ta representing values of a quantization-matrix for a 
color-difference intra-macroblock. The load_ 
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chroma_non_intra_quantizer_matrix data element is 
data used for indicating whether or not quantization-ma- 
trix data for a color-difference non-intra-macroblock ex- 
ists. The chroma_non_Jntra_quantizer_matrix data ele- 
ment is data representing values of a quantization-ma- 
trix for a co lor- difference non-intra-macroblock. 
[0262] The data elements defined by the 
copyright_extension { ) function are extension_ 
start_code, extension_start_code_identifier, copyright^ 
extension_present_flag, copyright_flag, copyright_ 
identifier, originat_or_copy, copyright_number„1 , 
copy_right_number_2 and copyright_number_3 as 
shown in Fig. 34. 

[0263] The data elements listed above are described 
as follows. The extension_start_code data element is a 
start code used for indicating the start of the copyright 
extension. The extension_start_code_identifier data el- 
ement is a code used for indicating which extension data 
is transmitted. The copyrighl_extension_present_flag 
data element is a flag used for indicating whether data 
elements of the copyright extension are valid or invalid. 
[0264] The copy rig ht_f lag data element is a flag used 
for indicating whether or not a copyright has been given 
to encoded video-data in a range up to the next copyright 
extension or the' end -of ; the sequence. The 
copyright_identifier data element is data used for iden- 
tifying an institution cataloging the copyright specified 
by the ISO/I EC JTC/SC29. The original_or_copy data 
element is a flag used for indicating whether data of the 
bit stream is original or copied data. The copyright 
number 1 data element indicates bits 44 to 63 of a cop- 
yright number. The copyright_number_2 data element 
indicates bits 22 to 43 of the copyright number. The 
copyright_number_3 data element indicates bits 0 to 21 
of the copyright number. 

[0265] The data elements defined by the 
picture_display_extension ( ) function are extension_ 
start_code_identifier, frame_center_horizontaLoffset 
and frame_center_vertical_offset as shown in Fig. 35. 
[0266] The data elements listed above are described 
as follows. The extension_start_code_identifierdata el- 
ement is a code used for indicating wh ich extension data 
is transmitted. The f rame_center_horizontal_offset data 
element is an offset of the display area in the horizontal 
direction. The number of such horizontal offsets can be 
defined by number_of_f ram e_center_off sets. The 
frame_center_vertical_offset data element is an offset 
of the display area in the vertical direction. The number 
of such vertical offsets can be defined by 
number_of_frame_center__offsets. 
[0267] As shown in the variable-length history stream 
of Fig. 24, data elements defined by a picture_data ( ) 
function are described as a history stream after the data 
elements defined by the extension_and_user(2) func- 
tion. It should be noted, however, that the picture_data 
( ) function exists if red_bw_flag has a value other than 
1 or red_bw_indicator has a value not exceeding 2. The 
red_bw_flag and the red_bw_indicator are described in 
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the re_coding_stream_info ( ) function and will be de- 
scribed later by referring to Figs. 48 and 49. 
[0268] As shown in Fig. 36, the data elements defined 
by a picture_data ( ) function are data elements defined 
by a slice ( ) function. It should be noted that at least one 5 
of the data elements defined by the slice ( ) function are 
described in the bit stream. 

[0269] As shown in Fig. 37, the slice ( ) function is a 
function -used for describing data elements such as 
slice_start_code, slice_quantiser_scale_code, intra_ 10 
sltce_flag, intra_slice J reserved_bits, extra_bit_siice, 
extra_information_slice and extra bit slice and data el- 
ements defined by a macroblock ( ) function as a history 
stream. 

[0270] The data elements listed above are described is 
as follows. The slice_start_code data element is a start 
code used for indicating the data elements defined by 
the slice ( ) function. The slice_quantiser_scale_code 
data element is the size of the quantization step defined 
for a macroblock existing in the slice layer. However, 20 
quantiser_scale_code set for mac rob locks is preferably 
used, when quantiser_scale_code has been set. 
[0271] The intra_slice_flag data segment is a flag 
used for indicating whether or not intra_slice and 
reserved_bits exist in the bit stream. The intra_slice data 25 
element is a flag used for indicating whether or not a 
non-intra-macroblock exists in the slice layer. To be 
more specific, if any one of macroblocks in the slice layer 
is a non-intra-macroblock, the intra_slice flag has a val- 
ue of "0". If all macroblocks in the slice layer are non- 30 
intra-macroblocks, on the other hand, the intra_slice flag 
has a value of "1". The reserved_bits data element is 
7-bit data having a value of "0". The extra_bit_slice data 
element is a flag used for indicating whether or not the 
extra_information_slice data element, that is, informa- 35 
tion added as a history stream, exists. To be more spe- 
cific, if the nextextra_information_slice data element ex- 
ists, the extra_bit_slice flag has a value of "1 ". If the next 
extra_information_slice data element does not exist, on 
the other hand, the extra_bit_slice flag has a value of <*o 
"0". 

[0272] Following the data element defined by the slice 
( ) function, data elements defined by a macroblock ( ) 
function are described as a history stream. 
[0273] As shown in Fig. 38. the macroblock ( ) func- *s 
tion are a function used for defining data elements such 
as macroblock_escape, macroblock_address_incre- 
ment, macroblock_quantiser_scale_code and 
marker_bit as well as data elements defined by a 
macroblock_modes ( ) function, a motion_vectors(s) so 
function and a coded_block_pattern ( ) function. 
[0274] The data elements listed above are described 
as follows. The macroblock_escape data element is a 
string of bits with a fixed length used for indicating 
whether or not a difference in the horizontal direction ss 
between a referenced macroblock and a preceding 
macroblock is at least 34 or greater. If the difference in 
the horizontal direction between a referenced macrob- 



lock and a preceding macroblock is at least 34 or great- 
er, 33 is added to the value of the macroblock_ 
address_increment data element. The macroblock_ 
address_increment data element is the difference in the 
horizontal direction between a referenced macroblock 
and a preceding macroblock. If one macroblock_escape 
data element exists before the macroblock_ 
addressjncrement data element, a value obtained as 
a result of the addition of 33 to the' value of the 
macroblock_address_increment data element repre- 
sents the actual difference in the horizontal direction be- 
tween a referenced macroblock and a preceding mac- 
roblock. 

[0275] The macrobtock_quantiser_scale_code data 
element is the size of the quantization step set in each 
macroblock and exists only if the value of 
macroblock_quant is 1. The slice_quantiser_ 
scale_code data element representing the size of the 
quantization step of a slice layer is also set in each slice 
layer. However, macroblock_scale_code set for a mac- 
roblock takes precedence of slice_quantiser_ 
scale_code 

[0276] Following the macroblock_address_increment 
data element, data elements defined svby the* 
macroblock_modes ( ) function are described; As 1 
shown in Fig. 39, the macroblock_modes ( ) function is 1 
a function used for describing data elements*.such as 
macroblock_type, frame_motion_type, field^motion_ 
type and dct_type as a history stream. ,x 
[0277] The data elements listed above are described 
as follows. The macroblock_type data element is data 
representing the encoding type of the macroblock. Its 
details will be described by referring to Figs. -42 to 44. 
[0278] If the macroblock_motion_forward flag or the 
macroblock_motion_backward flag has a. value of "1", 
the picture is transferred in the frame-prediction mode 
and, in addition, frame_pred_frame_dct has a value of 
"0", a data element representing frame_motion_type is 
described after a data element representing 
macroblockjype. It should be noted that 
frame_pred_frame_dct is a flag used for indicating 
whether or not frame_motion_type exists in the bit 
stream. 

[0279] The f rame_motion_type data element is a 2-bit 
code showing the prediction type of the macroblock of 
the frame. A frame_motion_type value of "00" indicates 
that there are two prediction vectors and the prediction 
type is a field-based prediction type. A frame_motion_ 
type value of "01" indicates that there is one prediction 
vector and the prediction type is a field-based prediction 
type. A frame_motion_type value of "10" indicates that 
there is one prediction vector and the prediction type is 
a frame-based prediction type. A frame_motion_type 
value of " 1 1 " indicates that there is one prediction vector 
and the prediction type is a dual-prime prediction type. 
. [0280] If a condition describing frame_motion_type is 
not satisfied, a data element representing 
field_motion_type is described after a data element rep- 
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resenting macroblock_type. 

[0281] The fielcLmotion_type data element is a 2-bit 
code showing the motion prediction of the macroblock 
of a field. A field_motion_type value of "01" indicates 
that there is one prediction vector and the prediction 5 
type is a field-based prediction type. A field_motion_ 
type value of "1 0" indicates that there is two prediction 
vectors and the prediction type is a 1 8 x 8 macroblock- 
based prediction type. A field_motion_type value of "11 " 
indicates that there is one prediction vector and the pre- 10 
diction type is a dual-prime prediction type. 
[0282] ff the picture is transferred in the frame predic- 
tion mode, frame_pred„frame_dct indicates that 
frame__motion_type exists in the bit stream and 
f rame_pred_frame_dct also indicates that dct_type ex- '5 
tsts in the bit stream, a data element representing 
dct_type is described after a data element representing 
macroblock_type. It should be noted that the dct_type 
data element is data used for indicating whether the 
DCT is carried out in the frame-DCT mode or the field- 20 
DCT mode. 

[0283] As shown in Fig. 38, if the referenced macrob- 
lock is either a forward-prediction macroblock or an in- 
tra-macroblock completing conceal processing, a data 
element defined by a motion_vectors(0) function is de- 25 
scribed. If the referenced macroblock is a backward- 
prediction macroblock, a data element defined by a 
motion_vectors(1) function is described. It should be 
noted that the motion_vectors(0) function is a function 
used for describing a data element related to a first mo- 30 
tion vector and the motion_vectors(1 ) function is a func- 
tion used for describing a data element related to a sec- 
ond motion vector. 

function is a function used for describing a data element 35 
related to a motion vector. 

[0285] If there is one motion vector and the dual-prime 
prediction mode is not used, data elements defined by 
motion_vertical_field_select[0][s] and motion_vector[0] 
[s] are described. 40 
[0286] The motion_vertical_field_select[r][s] is a flag 
used for indicating that the first vector, be it a forward- 
prediction or backward-prediction vector, is a vector 
made by referencing the bottom field or the top field. The 
subscript r] indicates the first or second vector whereas 45 
the subscripts] indicates a forward-prediction or back- 
ward-prediction vector. 

[0287] As shown in Fig. 41, the motion_vector(r, s) 
function is a function used for describing a data array 
related to motion_code[r][s][t], a data array related to so 
motion_residual[r][s][t] and data representing dmvector 
M. 

[0288] The motion_code[r][s][t] is data with a variable 
length used for representing the magnitude of a motion 
vector in terms of a value in the range -16 to +16. 55 
motion_residual[r][s][t] is data with a variable length 
used for representing a residual of a motion vector. 
Thus, by using the values of motion_code[r][s][t] and 



motion_residual[r][s][t], a detailed motion vector can be 
described. The dmvector[t] is data used for scaling an 
existing motion vector with a time distance in order to 
generate a motion vector in one of the top and bottom 
fields (for example, the top field) in the dual-prime pre- 
diction mode and used for correction in the vertical di- 
rection in order to reflect a shift in the vertical direction 
between lines of the top and bottom fields. The subscript 
[r] indicates the first or second vector whereas the sub- 
scripts] indicates a forward-prediction or backward-pre- 
diction vector. The subscript^] indicates that the motion 
vector is a component in the vertical or horizontal direc- 
tion. 

[0289] First of all, the motion_vector(r, s) function de- 
scribes a data array to represent motion_code[r][s][0] in 
the horizontal direction as a history stream as shown in 
Fig. 41 . The number of bits of both motion_residual [0] 
[s][t] and motion_residual [1][s] [t] is represented by 
f_code [s][t]. Thus, a value of f_code[s][t] other than "1 " 
indicates that motion_residual[r][s][t] exists in the bit 
stream. The fact that motion_residual[r][s][0]. a horizon- 
tal-direction component, is not "V and motion_code[r] 
[s][0], a horizontal-direction component, is not "0" indi- 
cates that a data element representing motion_residual 
[r][s][0] is included in the bit stream and 4he horizontal- 
direction component of the motion vector exists. In this 
case, a data element representing motion_residual[r][s] 
[0], a horizontal component, is thus described. 
[0290] - Subsequently, a data array to represent 
motion_code[r][s][1 ] is described in the vertical direction 
as a history stream. Likewise, the number of bits of both 
motion_residual[0][s][t] and motion_residual[1][s][t] is 
represented by f_code[s][t]. Thus, a value of f_codefs] 

exists in the bit stream. The fact that motion_residual [r] 
[s][1], a vertical-direction component, is not H 1" and 
motion_code[r][s][1], a vertical-direction component, is 
not "0" indicates that a data element representing 
motion_residual[r][s][1] is included in the bit stream and 
the vertical-direction component of the motion vector ex- 
ists. In this case, a data element representing 
motion_residual[r][s][1], a vertical component, is thus 
described. 

[0291] Next, macroblock_type is described by refer- 
ring to Figs. 42 to 44. The macroblock_type data ele- 
ment is data with a variable length generated from flags 
such as macroblock_quant, dct_type_flag, 
macroblock_motion_forward and macroblock_motion 
backward as shown in Figs. 42 to 44. The 
macroblock_quant flag is a flag used for indicating 
whether or not macroblock_quantiser_scale_code for 
setting the size of the quantization step for the macrob- 
lock is set. If macroblock_quantiser_scale_code exists 
in the bit stream, the macroblock_quant flag has a value 
of "1". 

[0292] A flag referred to as dct_type_flag is a flag 
used for indicating whether or not dct_type showing that 
the referenced macroblock has been encoded in the 
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frame-DCT mode or the field-DCT mode exists. In other 
words, dct_type_flag is a flag used for indicating wheth- 
er or not the referenced macroblock experienced DCT. 
If dct^type exists in the bit stream, dct_type_flag has a 
value of "1". The macroblock_motion_forward is a flag 5 
showing whether or not the referenced macroblock has 
undergone forward prediction. If the referenced macrob- 
lock has undergone forward prediction, the 
.macroblock_motion_forwardflag has a value of "1". On 
the other hand, macroblock_rnotion_backward is a flag 10 
showing whether or not the referenced macroblock has 
undergone backward prediction. If the referenced mac- 
roblock has undergone backward prediction, the 
macroblock_motion_backward flag has a value of "1". 
[0293] It should be noted that, in the variable-length is 
format, the history information can be eliminated in order 
to reduce the transfer rate of transmitted bits. 
[0294] For example, in order to transfer 
macroblock_lype and motion_vectors ( ), but not to 
transfer quantiser_scale_code, slice_quantiser_ 20 
scale_code is set at "00000" in order to reduce the bit 
rate. 

[0295] In addition, in order to transfer only 
macroblock_type but not to transfer motion_vectors ( ), 
quantiser_scale_code and dct_type, "not_coded" is 25 
used as macroblock_type in order to reduce the bit rate. 
[0296] Furthermore, in order to transfer only 
picture_coding_type but not to transfer all information 
following slice ( ), picture_data ( ) having no 
slice_start_code is used in order to reduce the bit rate. 30 
[0297] As described above, in order to prevent 23 
consecutive bits of 0 from appearing in user_data, a "1" 
bit is inserted for every 22 bits. It should be noted that, 
however, a "1 " bit can also be inserted for each number 
of bits smaller than 22. In addition, instead of insertion 35 
of a "1 " bit by counting the number of consecutive 0 bits, 
a M 1 " bit can also be inserted by examining Byte_allign. 
[0298] In addition, in the M PEG, generation of 23 con- 
secutive bits of 0 is prohibited. In actuality, however, only 
a sequence of such 23 bits starting from the beginning 40 
of a byte is a problem. That is to say, a sequence of such 
23 bits not starting from the beginning of a byte is not a 
problem. Thus, a "1" bit may be inserted for each typi- 
cally 24 bits at a position other than the LSB. 
[0299] Furthermore, while the history information is «5 
made in a format close to a video elementary stream as 
described above, the history information can also be 
made in a format close to a packetized elementary 
stream or a transport stream. In addition, even though 
user_data of the Elementary Stream is placed in front so 
of picture_data according to the above description, 
user_data can be placed at another location as well. 
[0300] The transponding system shown in Fig. 4 out- 
puts encoding parameters of 4 generations as history 
information to the succeeding stage. In actuality, how- 55 
ever, the history information is not all required. The re- 
quired history information varies from application to ap- 
plication. In addition, each actual transmission line and 



each recording medium or each transmission medium 
has a capacity limit. Even if history information is com- 
pressed, transmission of all the history information is a 
big load to be borne by a transmission means having a 
limited transmission capacity. In consequence, the bit 
rate of the picture bit stream must be unavoidably sup- 
pressed, inadvertently losing the effectiveness of the 
transmission of the history information. 
[0301] In order to solve this problem, a descriptor de- 
scribing a combination of items transmitted as history 
information is also transmitted to the succeeding stage 
by including the descriptor in the history information. In- 
stead of transmitting all history information, 
[0302] information to be transmitted is varied from ap- 
plication to application for a variety of applications. Fig. 
45 is a diagram showing a typical configuration of a 
transcoding system in which information to be transmit- 
ted is varied from application to application for a variety 
of applications. 

[0303] Components of the transcoding system shown 
in Fig. 45, which are identical with those employed in 
the transcoding system shown in Fig. 4, are denoted by 
the same reference numerals as the latter and their ex- 
planation is not repeated. In the typical configuration 
shown in Fig. 45, an encodi ng-pa ram eter>s electing cir- 
cuit 1 51 is provided between a history-information-sep-- 
arating apparatus 64 and an encoding apparatus 66 as- 
well as between a history-encoding apparatus 65 and 
the encoding apparatus 66. 

[0304] The encoding-parameter-selecting circuit 151 
comprises a combination-descriptor-separating unit 
161, an encoding-parameter-computing unit 162 and a 
switch 163. The encoding-parameter-computing unit 
162 computes encoding parameters from a base-band 
video signal output by the history-informatton-separat- 
ing apparatus 64. The combination-descriptor-separat- 
ing unit 161 separates encoding parameters and de- 
scriptors based on information on encoding parameters 
that are determined to be most optimum for an encoding 
process carried out by the video-encoding system 141 
including the encoding-parameter-selecting circuit 151 . 
The encoding parameters are output by encoding-pa- 
rameter-computing unit 1 62 on the basis of the base- 
band video signal output by the history-information-sep- 
arating apparatus 64. An example of optimum encoding 
parameters is encoding parameters of the second gen- 
eration. An example of the descriptors is red_bw_flag 
and red_bw_indicator, which will be described later by 
referring to Fig. 49. The switch 163 selects either the 
encoding parameters separated by the combination-de- 
scriptor-separating unit 1 61 or the encoding parameters 
computed by the encoding-parameter-computing unit 
1 62 in accordance with the descriptors separated by the 
combination-descriptor-separating unit 1 61 , and sup- 
plies the.selected parameters to the encoding apparatus 
66. The rest of the configuration is the same as that 
shown in Fig. 4. 

[0305] A combination of items transmitted as history 
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information is explained as follows. History information 
can be classified into information for each picture and 
information for each macroblock. Information for a slice 
can be obtained by gathering pieces of information for 
macroblocks included in the slice. By the same token, s 
information for a GOP can be obtained by gathering 
pieces of information for pictures included in the GOP. 
[0306] Since information for a picture, that is, informa- 
tion described in a V Blanking area shown in Fig. 7, is 
transmitted only once for each frame, the bit rate for the 10 
transmission of the information is not that high. On the 
other hand, since information for a macroblock, that is, 
information described in an H-blanking area shown in 
Fig. 7, needs to be transmitted a large number of times 
for each frame, information for each macroblock occu- is 
pies a large portion of history information. Assume for 
example a video system in which the number of scan- 
ning lines in 1 frame is 525, the field rate is 60 fields per 
second and the number of pixels per frame is 720 X 480. 
In this case, information for a macroblock needs to be 20 
transmitted 1 ,350 (= (720/16) X (480/1 6)) times for each 
frame. Accordingly, information for macroblocks occu- 
pies a large portion of history information. In order to 
solve this problem, while transmitted history information 
always includes at least information for each picture, in- 25 
formation for each macroblock is transmitted selectively 
corresponding to the application. In this way, the amount 
of transmitted information can be suppressed. 
[0307] Information to be transmitted as history infor- 
mation for each macroblock includes num_coef_bits, 30 
num_mv_bits, num_other_bits, q_scale_code, q_ 
scale_type, motion_type f mv_vert_field_sel [][], mv[] 
[ ][ ], mb _mfwd, mb_mbwd, mb_p attern, coded_ 

mb_quant and skipped_mb. These are expressed by 35 
using elements of macroblock rate information. 
[0308] The above pieces of information are described 
as follows. The num__coef_bits information is the size of 
codes in the macroblock required for expressing DCT 
coefficients. The num_mv_bits information is the size of 40 
a code in the macroblock required for expressing a mo- 
tion vector. The num_other_bits information is the size 
of codes in the macroblock other than those represented 
by num_coef_bits and num_mv_bits. 

[0309] The q„scale_code information is q_scale_ *s 
code applied to the macroblock. The motion_type infor- 
mation is the type of a motion vector applied to the mac- 
roblock. The mv_vert_field_sel[ ][ ] information is a field 
select of a motion vector applied to the macroblock. 
[031 0] The mv[ ]][ [ ] information is a motion vector ap- so 
plied to the macroblock. The mb_mfwd information is a 
flag indicating that the prediction mode of the macrob- 
lock is the forward-direction prediction mode. The 
mb_mbwd information is a flag indicating that the pre- 
diction mode of the macroblock is the backward-direc- 55 
tion prediction mode. The mb_pattem information is a 
flag indicating the presence/absence of a non-zero DCT 
coefficient of the macroblock. 



[0311] The coded_block__pattern information is a flag 
indicating the presence/absence of a non-zero DCT co- 
efficient of the macroblock for each DCT block. The 
mb_intra information is a flag indicating whether or not 
the macroblock is an intra„macro macroblock. The 
slice_start information is a flag indicating whether or not 
the macroblock is located at the beginning of a slice. 
The dct_type information is a flag indicating whether the 
macroblock is a field_dct or frame_dct macroblock. 
[0312] The mb_quant information is a flag indicating 
whether or not the transmitted macroblock includes 
quantiser_scale_code. The skipped_mb information is 
a flag indicating whether or not the macroblock is a 
skipped macroblock. 

[0313] The items described above are not always all 
needed. Instead, the needed items are determined in 
accordance with the application. For example, the 
num_coef_bits and sltce_start items are needed in an 
application with a transparent requirement to restore a 
bit stream, which is to be re-encoded, to a form as close 
to the original bit stream as possible. In other words, in 
an application changing the bit rate, these items are not 
required. In addition, applications with very strict restric- 
tions on the transmission line include applications that 
need to know only the encoding type of each picture; In 
such a condition, combinations each comprising items 
for transmitting history information are conceivable. Fig. 
46 is a diagram showing such typical combinations. 
[0314] For each of the combinations shown in Fig. 46, 
a value of 2 indicates that an item associated with the 
value is included in the combination and can be used 
whereas a value of 0 means that the item is not included 
in the combination. A value of 1 implies that the item is 
iHcllStle^iOT I ila r^i hf oTmatio n or 

simply for a syntactical reason . However, the item has 
nothing to do with the information of the original bit 
stream. Thus : the item itself is meaningless. For exam- 
ple, a value of 1 is assigned to the s(ice_start item in 
combinations 3 and 4 indicates that the macroblock is 
located at the beginning of a slice in the transmission of 
history information. However, the location of the slice is 
not necessarily the same as that in the original bit 
stream. If the location of the slice is changed, this item 
does not have any meaning as history information. 
[0315] By including or excluding some of (num_ 
coef_bits, num_mv_bits, num_other_bits), (q_scale_ 
code, q_scale_type), (motion_type, mv_vert_field_sel 
[ ] [ ]> mv t ][][]). (mb_mfwd, mb_mbwd), (mb_pattern), 
(coded_block_pattern), (mb_intra), (slice_start), 
(dct_type), (mb_quant) and (skipped_mb) items as 
shown in the example of Fig. 46 in 5 combinations, 
namely combinations 1 to 5, are obtained. 
[0316] Combination 1 is a combination intended for 
rebuilding a completely transparent bit stream. With this 
combination, it is possible to implement transcoding with 
high precision due to the use of information on the 
number of generated codes. Combination 2 is also a 
combination intended for rebuilding a completely trans- 
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parent bit stream. Even though combination 3 cannot 
be used for rebuilding a completely transparent bit 
stream, combination 3 is a combination intended for re- 
building a bit stream almost transparent to the sense of 
sight. From the transparency point of view, combination 5 
4 is inferiorto combination 3. Nevertheless, combination 
4 is a combination that can be used for rebuilding a bit 
stream with no problem appearing to the sense of sight. 
From the transparency point of view, combination 5 is 
inferior to combination 4. However, combination 5 is a 10 
combination that can be used for imperfect rebuilding of 
a bit stream with little history information. 
[0317] The lower the number assigned to any of the 
above combinations, the better the function of the com- 
bination but the larger the capacity required for trans- '5 
mission of the history information. It is thus necessary 
to select a combination to be transferred by considering 
the assumed application and the transmission capacity 
useable for the history information. 

[0318] The following description explains the opera- 20 
tion of the transcoding system shown in Fig. 45 by re- 
ferring to a flowchart shown in Fig. 47. 
[0319] The flowchart shown in Fig. 47 begins with a 
step SI at which the decoding apparatus 61 employed 
in the video-decoding system 51 decodes an input bit 25 
stream and extracts encoding parameters of the fourth 
generation, which are used for encoding the bit stream. 
The decoding apparatus 61 supplies the encoding pa- 
rameters of the fourth generation and the decoded video 
data to the history-information-muitiplexing apparatus 30 
63. At the next step S2, the decoding apparatus 61 ex- 
tracts user_data from the input bit stream and supplies 
it to the history-decoding apparatus 62. At the next step 
S3, the history-decoding apparatus 62 extracts informa- 
tion on a combination (or descriptors) from user_data 35 
and uses the information for extracting encoding param- 
eters of the second and third generations received as 
history information. The history-decoding apparatus 62 
then supplies the encoding parameters to the history- 
infomnation-muttiplexing apparatus 63. 40 
[0320] At the next step S4, the history-information- 
multiplexing apparatus 63 multiplexes the encoding pa- 
rameters of the fourth, second and third generations in 
the base-band video data received from the decoding 
apparatus 61 in accordance with the formats shown in 45 
Figs, 7 and 1 1 , and supplies a result of the multiplexing 
to the history-information-separating apparatus 64. The 
current encoding parameters of the fourth generation 
were extracted at the step S1 by the decoding apparatus 
61 whereas the past encoding parameters of the second so 
and third generations were extracted at the step S3 by 
the history-decoding apparatus 62. 
[0321] At the next step S5, the history-information- 
separating apparatus 64 extracts the encoding param- 
eters from the base-band video data received from the 55 
history-information-multiplexing apparatus 63 and se- 
lects encoding parameters most optimum for the current 
encoding process. An example of the encoding param- 



eters most optimum for the current encoding process is 
the encoding parameters of the second generation. The 
history-information-separating apparatus 64 then sup- 
plies the most optimum encoding parameters and the 
descriptors to the combination-descriptor-separating 
unit 161 . The history-information-separating apparatus 
64 supplies encoding parameters other than the encod- 
ing parameters determined to be most optimum this time 
to the history-encoding apparatus 65. If the encoding 
parameters of the second generation are determined to 
be most optimum, for example, the history-information- 
separating apparatus 64 supplies the encoding param- 
eters of the first, third and fourth generations to the his- 
tory-encoding apparatus 65. 

[0322] At the next step S6, the history-encoding ap- 
paratus 65 writes the encoding parameters received 
from the history-information-separating apparatus 64 in 
user_data and supplies this user_data or 
converted_history_stream ( ) to the encoding apparatus 
66. 

[0323] At the next step S7 ; the combination-descrip- 
tor-separating unit 1 61 separates the encoding param- 
eters of the second generation and the descriptors from 
the data received from the history-information-separat- 
ing apparatus 64, supplying the parametersvtoone con-: ■ 
tact point of the switch 163. On the other hand, the en-- 
coding-parameter-computing unit 1 62 computes encod- 
ing parameters from the base-band video data received 
from the historyvnformation-separating apparatus 64 
and supplies the computed parameters to another con- 
tact point of the switch 1 63. 

[0324] At the next step S8, the switch 163 selects ei- 
ther the encoding parameters received from the combi- 
nation-descriptor-separating unit 161 or the, encoding 
parameters received from the encoding-parameter- 
computing unit 162 in accordance with the descriptors 
received from the combination-descriptor-separating 
unit 161 , and supplies the selected parameters to the 
encoding apparatus 66. To put it in detail, the switch 1 63 
selects the encoding parameters received from the 
combination-descriptor-separating unit 161 if the pa- 
rameters are valid. If the encoding parameters received 
from the combination-descriptor-separating unit 1 61 are 
invalid, on the other hand, the switch 163 selects the 
encoding parameters received from the encoding-pa- 
rameter-computing unit 162, which computed the pa- 
rameters as a result of processing of the base-band vid- 
eo data. The encoding parameters are selected in ac- 
cordance with the capacity of the transmission media. 
[0325] At the next step S9, the encoding apparatus 
66 encodes the base-band video data received from the 
history-information-separating apparatus 1 05 on the ba- 
sis of the encoding parameters received from the switch 
163. 

[0326] At the next step S10, the encoding apparatus 
66 multiplexes user_data received from the history-en- 
coding apparatus 65 in the encoded bit stream and out- 
puts a result of the multiplexing before terminating the 
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processing. 

[0327] In this way, even if the combination of encoding 
parameters obtained as history information varies, 
transcoding can be carried out without a problem. 
[0328] As described above, history information is 
transmitted as history_stream ( ), a kind of the 
user__data function of the video stream, as shown in Fig. 
1 5. Speaking accurately, history information is transmit: 
ted as converted_history__stream ( ). The syntax of 
hi story _stream ( ) is shown in Fig. 24. The red_bw_flag 
and red_bw__indicator descriptors, which show a com- 
bination of history-information items, and items not sup- 
ported in an MPEG stream are transmitted as the 
re_coding_stream_info ( ) function shown in Fig. 24. 
The items not supported in an MPEG stream are 
num_otherjDits, num_mv_bits and num_coef_bits. 
[0329] As shown in Fig. 48, the re_coding_ 
stream_info ( ) function comprises data elements such 
as user_dala_slart_code, re_coding_stream_infoJD, 
red_bw_flag, red_bw_indicator, marker_bit f num_ 
other_bits, num_mv_bits and num_coef_bits. 
[0330] The above data elements are described as fol- 
lows. The user_data_start_code data element is a start 
code indicating the beginning of user„data. The 
re_coding_stream_info_ID data item is a 16-bit integer 
used for identifying the re_coding_stream_info ( ) func- 
tion. To put it concretely, the value of the 
re_coding_stream_info_ID data item is "1001 0001 
1110 1100" (or 0x91 ec). 

[0331] The red_bw_flag data element is a 1-bit flag. 
When all items of the history information are transmitted, 
the flag is reset to 0. If the flag is set at 1 , the 
red_bw_indicator data element following the flag is ex- 
amined to select one of the 5 combinations shown in 
Fig. 46. In this way, it is possible to determine what items 
have been transmitted. 

[0332] The red_bw_indicator data element is a 2-bit 
integer indicating the combinations of elements as 
shown in Fig. 49. 

[0333] To be more specific, the 5 combinations shown 
in Fig. 46 are indicated as follows. Combination 1 is in- 
dicated by the value of the red_bw_flag data element 
reset to 0. On the other hand, combinations 2 to 5 are 
indicated by the value of the red_bw_flag data element 
set at 1 . Combinations 2, 3, 4 and 5 are indicated by the 
value of the red_bw_Jndicator data element set at 0. 1 , 
2 and 3 respectively. 

[0334] Thus, the red_bw_indicator data element indi- 
cates one of combinations 2 to 5 only if the red_bw_flag 
data element is set at 1 . 

[0335] In addition, in the case of combination 1 shown 
in Fig. 49 as indicated by the red_bw_flag data element 
reset to 0, the marker_bit, num_other_bits, 
num_mv_bits and num_coef_bits data elements are de- 
scribed for each macroblock. These 4 data elements are 
not described for combinations 2 to 5 indicated by the 
red_bw_flag data element set at 1 . 
[0336] As shown in Fig. 36, the picture_data ( ) func- 



tion comprises one or more slice ( ) functions. In the 
case of combination 5, however, the picture_data ( ) 
function and syntax elements below this picture_data ( ) 
function are not transmitted. In this case, the history in- 

5 formation is intended for information to be transmitted 
for each picture such as picture_type. 
[0337] In the case of combinations 1 to 4, the slice ( ) 
function shown in Fig. 37 exists. In this case, however, 
information on the position of a slice determined by the 

10 slice ( ) function and information on the position of a slice 
of the original bit stream are dependent on the combi- 
nation of hi story- information items. In addition, in the 
case of combination 1 or 2, it is necessary to have the 
same information on the position of a slice determined 

*5 by the slice ( ) function as information on the position of 
a slice of the original bit stream. 

[0338] Syntax elements of the macroblock ( ) function 
shown in Fig. 38 are dependent on a combination of his- 
tory-information items. Syntax elements referred to as 

20 macroblock_escape and macroblock_address_incre- 
ment as well as a macrob!ock„modes ( ) function always 
exist. However, the validity of the macroblock_escape 
and macroblock_address_increment syntax elements 
is determined by the combination. If the combination of 

25 r history-information items is combination 1 or 2, it is nec- 
essary to transmit the same information as skipped_mb 
of the original bit stream. 

[0339] In the case of combination 4, the 
motion_vector ( ) function does not exist, tn the case of 

30 combinations 1 to 3, on the other hand, macroblock. 
type of the macroblock_modes ( ) function determines 
the existence of the motion„vector ( ) function. In the 
case of combination 3 or 4, the coded_block_pattern { ) 
function does not exist. In the case of combination 1 or 

35 2, on the other hand, the macroblock_type of the 
macroblock_modes ( ) function determines the exist- 
ence of the coded_block_pattem ( ) function. 
[0340] Syntax elements of the macroblock_modes ( ) 
function shown in Fig. 39 are dependent on a combina- 

40 tion of history-information items. A syntax element re- 
ferred to as macroblock_type always exists. In the case 
of combination 4 : frame_motion_type, field_motion type 
and dct_type syntax elements do not exist. 
[0341] The combination of history-information items 

45 determines the information validity of parameters ob- 
tained from the macrobtockjype syntax element. 
[0342] If the combination of history-information items 
is combination 1 or 2, macroblock_quant must be the 
same as that of the original bit stream. If the combination 

50 of history-information items is combination 3 or 4, on the 
other hand, macroblock_quant indicates the existence 
of quantiser_scale_code in the macroblock ( ) function 
and does not have to be the same as that of the original 
bit stream. 

55 [0343] If the combination of history- information items 
is combinations 1 to 3, macroblock_motion_forward and 
macroblock_motion_backward must be the same as 
those of the original bit stream. If the combination of his- 
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tory-information items is combination 4 or 5, on the other 
hand, macroblock_motion_Jorward and macroblock_ 
motion_backward do not have to be the same as those 
of the original bit stream. 

[0344] If the combination. of history-information items 
is combination 1 or 2, macroblock_pattern must be the 
same as that of the original bit stream. If the combination 
of history-information items is combination 3, 
macroblock_pattern is used for indicating the existence 
of dct_type. If the combination of history-information 
items is combination 4, the relations for combinations 1 
to 3 do not hold true. 

[0345] If the combination of history-information items 
is any one of combinations 1 to 3, maroblock_intra must 
be the same as that of the original bit stream. If the com- 
bination of history-information items is combination 4, 
on the other hand, marobiockjntra does not have to be 
the same as that of the original bit stream. 
[0346] The history_stream function shown in Fig. 24 
has a syntax for history information with a variable 
length. In the case of syntaxes for fixed lengths shown 
in Figs. 17 to 23, however, as portions of fixed-length 
history information for indicating which transmitted 
items are valid, descriptors, namely, red_bw_flag and 
red_bw_indicator, are superposed on a base-band pic- 
ture prior to transmission. As a result, by examining the 
descriptors, is possible to determine that the contents 
of an existing field are invalid. 

[0347] Thus, as re_cod i ng_st ream Jn format ion, 
user_data_start_code, re_coding_stream_infoJD, 
red_bw_flag. red_bw_indicator and marker_bit are pro- 
vided as shown in Fig. 21 . Their meanings have been 
explained by referring to Fig. 48. 
[0348] By transmitting history information as a combi- 
nation of encoding parameters dependent on the appli- 
cation as described above, history information, which is 
dependent on the application and has a proper amount 
of data, can be transmitted. 

[0349] In transmission of history information as code 
with a variable length as described above, the 
re_coding_stream_info ( ) function is composed in a for- 
mat shown in Fig. 48 and transmitted as a part of the 
history_stream ( ) function as shown in Fig. 24. If history 
information is transmitted as code with a fixed length, 
on the other hand, the re_coding_stream_infomation ( ) 
function is transmitted as a part of the history_stream ( ) 
function as shown in Fig. 21 . In the example shown in 
Fig. 21 , as re_coding_stream_information, user_data_ 
start_code, re_coding_stream_infoJD, red_bw_flag 
and red_bw_indicator are transmitted. 
[0350] In addition, a format of a Re_Codtng informa- 
tion Bus macroblock like one shown in Fig. 50 is pre- 
scribed to transmit history information in a base-band 
signal output by the history-informatton-multiplexing ap- 
paratus 63 employed in the transcoding system shown 
in Fig. 45. This macroblock consists of 256 (= 16 X 16) 
bits. 32 bits on the third and fourth rows from the top of 
the macroblock shown in Fig. 50 are picrate_element 



comprising picture-rate elements shown in Figs. 51 to 
53. On the second row from the top of the picture-rate 
elements shown in Fig. 51 f red_bw_flag with a length of 
1 bit is prescribed. On the third row from the top of the 
5 picture-rate elements shown in Fig. 51 , red_bw_indica- 
tor with a length of 3 bits is prescribed. That is to say, 
the red_bw_flag and red_bw_indicator flags are trans- 
mitted as picrate_element shown in Fig. 50.. 
[0351] Other data shown in Fig. 50 is explained as fol- 

10 lows. SRIB_sync_code is a code used for indicating that 
data on the first line of the macroblock is aligned by 
packing the data to the left end of the line. To put it con- 
cretely, the code is set at " 1 1 1 11 For a picture_structu re 
value of 11 indicating a frame picture structure, 

15 fr_fl_SRIB is set at 1 to indicate that the Re_Coding in- 
formation Bus macroblock is transmitted, exceeding 16 
lines: For a picture_structure value indicating a structure 
other than the frame picture structure, on the other hand, 
fr_fl_SRIB is reset to 0 to indicate that the Re_Coding 

20 information Bus macroblock is transmitted, exceeding 
16 lines. With this mechanism, the Re_Coding informa- 
tion Bus macroblock is locked spacewise arid timewise 
to pixels corresponding to a decoded video frame or a 
decoded video field. > ^ r : 

25 [0352] SRIB_top_field_first is set at m^sameyalue 
as top_field_first held in the original bit stream and used 
for representing time alignment of Re_Codinglnforma- 
tion Bus of a related video in conjunction with 
repeat_first_field. SRIB_ repeat_first_field is set at the 

30 same value as repeat_first_field held in the:original bit 
stream. Contents of the Re_Coding information Bus 
macroblock of the first field need to be repeated as in- 
dicated by this flag. 

[0353] 422_420_chroma indicates whether4he origi- 
35 nal bit stream is either a 4 : 2 : 2 stream 1 or a 4 : 2 : 0 
stream. To be more specific, a 422_420_chroma value 
reset to 0 indicates that the original bit stream is a 4 : 2 : 
0 stream. In this case, the 422_420_chroma value indi- 
cates that up-sampling of a chrominance signal is car- 
40 ried out to output a 4 : 2 : 2 video. The value of 0 indi- 
cates that a process to filter the chrominance signal is 
not carried out. 

[0354] The rolling_SRIB_mb_ref data item indicates 
16-bit modulo 65,521. The value of rolling_SRIB_ 
mb_ref is incremented for each macroblock. This value 
must vary continuously over frames in the structure of 
frame pictures. If not, this value must vary continuously 
over fields. The rol!ing_SRIB_mb_ref data item is set at 
a predetermined value between 0 and 65,520. By doing 
50 so, embedding a unique descriptor of a Re_Coding In- 
formation Bus macroblock in a recorder system is per- 
mitted. 

[0355] Meanings of other data of the Re_Coding In- 
formation Bus macroblock have been described above, 
55 making it unnecessary to repeat the explanation. 

[0356] As shown in Fig. 54, 256-bit data of Re_Coding 
Information Bus macroblock shown in Fig. 50 is distrib- 
uted in bit units among LSBs of the chrominance data, 
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namely, Cb[0][0], CrtOKO], Cb[1][0] and Cr[1][0]. By the 
format shown in Fig. 54, 4 bits of the data can thus be 
transmitted. Accordingly, in orderto transmit the 256 bits 
of the data shown in Fig. 50, it is necessary to transmit 
64 (= 256/4) pieces of data each having the format 
shown in Fig. 54. 

[0357] In the transcoding system provided by at least 
preferred embodiments of the present invention for re- 
ducing the amount of cumulative amount of picture- 
quality deterioration caused by decoding and encoding 
processes carried out as described above, encoding pa- 
rameters generated in previous encoding processes are 
recorded in V Blanking and H-blanking areas in accord- 
ance with a frequency of use of the information. Thus, 
the information can be fetched with ease when the in- 
formation is required. In addition, pieces of hardware 
can be selected in accordance with desired information 
or pieces of hardware can be eliminated if they are not 
required. 

[0358] In addition, in the transcoding system provided 
by at least preferred embodiments of the present inven- 
tion, a synchronization code referred to as start_code is 
always written at the beginning of a packet by the video- 
decoding system. Thus, the video-encoding system is. 
capable of restoring a lost input packet with ease. 
[0359] In the above description, the present invention 
is exemplified by a case in which compressed encoding 
parameters are transmitted. It should be noted, howev- 
er, that the present invention can also be applied to a 
case wherein encoding parameters are transmitted 
without being compressed. 

[0360] It is also worth noting that programs to be ex- 
ecuted by a computerfor carrying out pieces of process- 
ing described above can be presented to the user 
through network presentation media such as the inter- 
net or a digital satellite to be recorded into the user's 
recording medium and presented by using recording 
media such as a magnetic disc, an optical disc, a mag- 
netooptical disc and a semiconductor memory to be pre- 
sented to the user. 

[0361] In addition, steps composing each of the pro- 
grams presented through the media as described in this 
specification can of course be pieces of processing to 
be carried sequentially one after another out along the 
time axis in accordance with a pre-prescribed order. It 
should be noted, however, that the steps do not have to 
be pieces of processing to be carried out sequentially 
along the time axis. Instead, they may include pieces of 
processingto be performed individually and concurrent- 

[0362] It is also worth noting that, in this specification, 
the technical term "system" implies the entire apparatus 
comprising a plurality of sub-apparatuses and units. 
[0363] In so far as the embodiments of the invention 
described above are implemented, at least in part, using 
software-controlled data processing apparatus, it will be 
appreciated that a computer program providing such 
software control and a storage medium by which such 



a computer program is stored are envisaged as aspects 
of the present invention. 



5 Claims 

1. An information-processing apparatus for decoding 
.an input encoded stream and generating an output 
signal, said information-processing apparatus com- 

10 prising: 

extraction means for extracting auxiliary data 

from said input encoded stream; 

separation means for splitting said auxiliary da- 

15 ta extracted by said extraction means into first 

auxiliary data and second auxiliary data; 
conversion means for converting said first aux- 
iliary data and said second auxiliary data, which 
were separated by said separation means, into 

20 data having a predetermined format; and 

insertion means for inserting said first auxiliary 
data and said second auxiliary data, which 
were converted by said conversion means, into 
a first position and a second position of said 

25 output signal respectively. 

2. An information-processing apparatus according to 
claim 1 wherein said auxiliary data includes encod- 
ing parameters. 
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3. An inform at ion -processing apparatus according to 
claim 1 wherein said first auxiliary data is inserted 
into a vertical-blanking area of said output signal 
and said second auxiliary data is inserted into a hor- 
izontal-blanking area of said output signal. 

4. An information-processing apparatus according to 
claim 1 , said information-processing apparatus fur- 
ther having a synchronization-code-adding means 
for adding a synchronization code to the head of a 
packet of said output signal. 

5. An information-processing apparatus according to 
claim 1 wherein said input encoded stream is com- 
pressed data and said extraction means extracts 
said auxiliary, data from said compressed data. 

6. An information -processing method adopted by an 
information-processing apparatus for decoding an 
input encoded stream and generating an output sig- 
nal, said information-processing method compris- 
ing: 



an extraction step of extracting auxiliary data 
55 from said input encoded stream; 

a separation step of splitting said auxiliary data 
extracted at said extraction step into first auxil- 
iary data and second auxiliary data; 
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a conversion step of converting said first auxil- 
iary data and said second auxiliary data, which 
were separated at said separation step, into da- 
ta having a predetermined format; and 
an insertion step of inserting said first auxiliary 
data and said second auxiliary data, which 
were converted at said conversion step, into a 
first position and a second position of said out- 
put signal respectively. 

7. A recording medium employed in an information- 
processing apparatus for decoding an input encod- 
ed stream and generating an output signal, said re- 
cording medium used for recording a program exe- 
cutable by a computer to implement a method com- 
prising: 

an extraction step of extracting auxiliary data 
from said input encoded stream; 
a separation step of splitting said auxiliary data 
extracted at said extraction step into first auxil- 
iary data and second auxiliary data; 
a conversion step of converting said first auxil- 
iary data and said second auxiliary data, which 
were separated at said separation step, into da- 
ta having a predetermined format; and 
an insertion step of inserting said first auxiliary 
data and said second auxiliary data, which 
were converted at said conversion step, into a 
first position and a second position of said out- 
put signal respectively. 

8. An information-processing apparatus for encoding 
an input signal and generating an output signal, said 
information-processing apparatus comprising: 

extraction means for extracting first auxiliary 
data or second auxiliary data, which were in- 
serted into a first position or a second position 
of said input signal respectively; 
selection means for selecting either said first 
auxiliary data or said second auxiliary data, 
which were extracted by said extraction means; 
and 

encoding means for encoding said input signal 
by utilizing said first auxiliary data or said sec- 
ond auxiliary data, which were selected by said 
selection means. 

9. An information-processing apparatus according to 
claim 8, said information-processing apparatus fur- 
ther having: 

generation means for generating third auxiliary 
data based on either said first auxiliary data or 
said second auxiliary data, which was used by 
said encoding means, as well as said first aux- 
iliary data and said second auxiliary data, which 



were extracted by said extraction means; and 
recording means for recording said third auxil- 
iary data generated by said generation means 
into said output signal. 

5 

10. An information -processing apparatus according to 
claim 8 wherein said first auxiliary data, said second 
auxiliary data and said third auxiliary data each in- 
clude encoding parameters. 

w 

11. An information -processing apparatus according to 
claim 8 wherein said extraction means extracts said 
first auxiliary data from a vertical-blanking area of 
said input signal and said second auxiliary data 

'5 from a horizontal-blanking area of said input signal. 

12. An information-processing apparatus according to 
claim 8, said information-processing apparatus fur- 
ther having a reproduction means, which is used for 

20 reproducing a lost portion of said input signal by re- 

ferring to the head of an input packet in case said 
lost portion is missing from said input signal. 

13. An information-processing method adopted in an 
25 information-processing apparatus fomerrcoding an 

input signal and generating an output signal, said 
information-processing method comprising: 

* - 

an extraction step of extracting first auxiliary 
30 data or second auxiliary data, which were in- 

serted into a first position or a second position 
of said input signal respectively; 
a selection step of selecting either said first 
auxiliary data or said second auxiliary data, 
35 which were extracted at said extraction step; 

and 

an encoding step of encoding said input signal 
by utilizing said first auxiliary data or said sec- 
ond auxiliary data, which were selected at said 
40 selection step. 

14. A recording medium employed in an information- 
processing apparatus for encoding an input signal 
and generating an output signal, said recording me- 

45 dium used for recording a program executable by a 

computer to implement a method comprising: 

an extraction step of extracting first auxiliary 
data or second auxiliary data, which were in- 
50 serted into a first position or a second position 

of said input signal respectively; 
a selection step of selecting either said first 
auxiliary data or said second auxiliary data, 
which were extracted at said extraction step; 
55 and 

an encoding step of encoding said input signal 
by utilizing said first auxiliary data or said sec- 
ond auxiliary data, which were selected at said 
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selection step. 

15. An information-processing apparatus for generat- 
ing a second encoded stream from a first input en- 
coded stream and outputting said second encoded 5 
stream, said information-processing apparatus 
comprising: 

decoding means for decoding said first input 
encoded stream; and 10 
generation means for encoding said first en- 
coded stream decoded by said decoding 
means to generate said second encoded 
stream, 

15 

wherein: 

said decoding means comprises: 

first extraction means for extracting auxiliary 
data from said first input encoded stream; 20 
separation means for splitting said auxiliary da- 
ta extracted by said first extraction means into 
first auxiliary data and second auxiliary data; 
conversion means for converting said first aux- 
iliary data and said second auxiliary data, which 25 
were separated by said separation means, into 
data having a predetermined format; and 
insertion means for inserting said first auxiliary 
data and said second auxiliary data, which 
were converted by said conversion means, re- 30 
spectively into a first position and a second po- 
sition of said first encoded stream decoded by 
said decoding means; 
'sl^^ 

ed stream by using said auxiliary data extracted 35 
by said first extraction means; 
said generation means comprises: 

second extraction means for extracting 
said first auxiliary data or said second aux- 40 
iliary data respectively from said first posi- 
tion or said second position of said first en- 
coded stream decoded by said decoding 
means; and 

selection means for selecting either said ^ 
first auxiliary data or said second auxiliary 
data, which were extracted by said second 
extraction means; and 
said generation means encodes said first 
encoded stream decoded and supplied so 
thereto by said decoding means by using 
said first auxiliary data or said second aux- 
iliary data, which was selected by said se- 
lection means, to generate said second en- 
coded stream. 55 

16. An information -processing apparatus according to 
claim 15 wherein said first auxiliary data and said 



second auxiliary data each include encoding pa- 
rameters. 

17. An information-processing apparatus according to 
claim 15 wherein said insertion means inserts said 
first auxiliary data into a vertical-blanking area of 
said first encoded stream decoded by said decod- 
ing means and said second auxiliary data into a hor- 
izontal-blanking area of said first encoded stream 
decoded by said decoding means. 

18. An information-processing apparatus according to 
claim 15 wherein said decoding means further has 
a synchronization-code-adding means for adding a 
synchronization code to the head of a packet of a 
signal output to said encoding means. 

19. An information-processing method adopted by an 
information-processing apparatus for generating a 
second encoded stream from a first input encoded 
stream and outputting said second encoded 
stream, said information-processing method com- 
prising: 

a decoding step of decoding said first input en^ 
coded stream; and 

a generation step of encoding said first encod- 
ed stream decoded at said decoding step to 
generate said second encoded stream, 

wherein: 

said decoding step comprises: 

data from said first input encoded stream; 
a separation sub-step of splitting said auxiliary 
data extracted at said first extraction sub-step 
into first auxiliary data and second auxiliary da- 
ta; 

a conversion sub-step of converting said first 
auxiliary data and said second auxiliary data, 
which were separated at said separation sub- 
step, into data having a predetermined format; 
and 

an insertion sub-step of inserting said first aux- 
iliary data and said second auxiliary data, which 
were converted at said conversion sub-step, re- 
spectively into a first position and a second po- 
sition of said first encoded stream decoded at 
said decoding step; 

said decoding step is executed to decode said 
first encoded stream by using said auxiliary da- 
ta extracted at said first extraction sub-step; 
said generation step comprises: 

a second extraction sub-step of extracting 
said first auxiliary data or said second aux- 
iliary data respectively from said first posi- 
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tion or said second position of said first en- 
coded stream decoded at said decoding 
step: and 

a selection sub-step of selecting either said 
first auxiliary data or said second auxiliary 5 
data, which was extracted at said second 
extraction sub-step; and 
said generation step is executed to encode, 
said first encoded stream decoded and 
supplied thereto at said decoding step by 10 
using said first auxiliary data or said sec- 
ond auxiliary data, which was selected at 
said selection sub-step, to generate said 
second encoded stream. 

15 

20. A recording medium employed in an information- 
processing apparatus for generating a second en- 
coded stream from a first input encoded stream and 
outputting said second encoded stream, said re- 
cording medium used for recording a program exe- 20 
cutable by a computer to implement a method com- 
prising: 

a decoding step of decoding said first input en- 
coded stream; and 25 
a generation step of encoding said first encod- 
ed stream decoded at said decoding step to 
generate said second encoded stream, 

wherein: 30 
said decoding step comprises: 

a first extraction sub-step of extracting auxiliary 
data from said first input encoded stream; 
a separation sub-step of splitting said auxiliary 35 
data extracted at said first extraction sub-step 
into first auxiliary data and second auxiliary da- 
ta; 

a conversion sub-step of converting said first 
auxiliary data and said second auxiliary data, 40 
which were separated at said separation sub- 
step, into data having a predetermined format; 
and 

an insertion sub-step of inserting said first aux- 
iliary data and said second auxiliary data, which 45 
were converted at said conversion sub-step, re- 
spectively into a first position and a second po- 
sition of said first encoded stream decoded at 
said decoding step; 

said decoding step is executed to decode said so 
first encoded stream by using said auxiliary da- 
ta extracted at said first extraction sub-step; 
said generation step comprises: 

a second extraction sub-step of extracting ss 
said first auxiliary data or said second aux- 
iliary data respectively from said first posi- 
tion or said second position of said first en- 
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coded stream decoded at said decoding 
step; and 

a selection sub-step of selecting either said 
first auxiliary data or said second auxiliary 
data, which was extracted at said second 
extraction sub-step; and 
said generation step is executed to encode 
said first encoded stream decoded and 
supplied thereto at said decoding step by 
using said first auxiliary data or said sec- 
ond auxiliary data, which was selected at 
said selection sub-step, to generate said 
second encoded stream. 

21. A decoding apparatus for decoding an encoded 
source stream, said decoding apparatus compris- 
ing: 

decoding means for decoding said encoded 
source stream in orderto generate a base-band 
video signal by using encoding parameters in- 
cluded in said encoded source stream; 
vertical insertion means for inserting much re- 
quired ones among said encoding parameters 
into a vertical-blanking period olcsai el;. base- 
band video signal; and 

horizontal insertion means for inserting little re- 
quired ones among said encoding parameters 
into a horizontal-blanking period of said base- 
band video signal. *r 

22. A decoding method adopted by a decoding appa- 
ratus for decoding an encoded source stream, said 
decoding method comprising the steps of:: 

decoding said encoded source stream in order 
to generate a base-band video signal by using 
encoding parameters included in said encoded 
source stream: 

inserting much required ones among said en- 
coding parameters into a vertical-blanking pe- 
riod of said base-band video signal; and 
inserting little required ones among said encod- 
ing parameters into a horizontal-blanking peri- 
od of said base-band video signal. 

23. A decoding apparatus for decoding an encoded 
source stream, said decoding apparatus compris- 
ing: 

decoding means for decoding said encoded 
source stream in orderto generate a base-band 
video signal by using encoding parameters in- 
cluded in said encoded source stream; 
vertical insertion means for inserting those of 
picture and higher layers among said encoding 
parameters into a vertical-blanking period of 
said base-band video signal; and 
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horizontal insertion means for inserting those 
of slice and lower layers among said encoding 
parameters into a horizontal-blanking period of 
said base-band video signal. 

5 

24. A decoding method adopted by a decoding appa- 
ratus for decoding an encoded source stream, said 
decoding method comprising the steps of: 

decoding said encoded source stream in order 10 
to generate a base-band video signal by using 
encoding parameters included in said encoded 
source stream; 

inserting those of picture and higher layers 
among said encoding parameters into a verti- is 
cal-blanking period of said base-band video 
signal; and 

inserting those of slice and lower layers among 
said encoding parameters into a horizontal- 
blanking period of said base-band video signal. 20 

25. A decoding apparatus for decoding an encoded 
source stream, said decoding apparatus compris- 
ing: 

25 

decoding means for decoding said encoded 
source stream in order to generate a base-band 
video signal by using encoding parameters in- 
cluded in said encoded source stream; 
vertical insertion means for inserting general 30 
ones among said encoding parameters into a 
vertical-blanking period of said base-band vid- 
eo signal; and 

horizontal insertion means for inserting de- 
tailed ones among said encoding parameters 35 
into a horizontal-blanking period of said base- 
band video signal. 

26. A decoding method adopted by a decoding appa- 
ratus for decoding an encoded source stream, said *o 
decoding method comprising the steps of: 

decoding said encoded source stream in order 
to generate a base-band video signal by using 
encoding parameters included in said encoded 45 
source stream; 

inserting general ones among said encoding 
parameters into a vertical-blanking period of 
said base-band video signal; and 
inserting detailed ones among said encoding so 
parameters into a horizontal-blanking period of 
said base-band video signal. 

27. An encoding apparatus for encoding a base-band 
video signal, said encoding apparatus comprising: 55 

extraction means for extracting much required 
encoding parameters from a vertical blanking 



period of said base-band video signal and little 
required encoding parameters from a horizon- 
tal blanking period of said base-band video sig- 
nal; and 

re-encoding means for re-encoding said base- 
band video signal by referring to said much re- 
quired encoding parameters and said little re- 
quired encoding parameters. 

28. An encoding method adopted in an encoding appa- 
ratus for encoding a base-band video signal, said 
encoding method comprising the steps of: 

extracting much required encoding parameters 
from a vertical blanking period of said base- 
band video signal and little required encoding 
parameters from a horizontal blanking period of 
said base-band video signal; and 
re-encoding said base-band video signal by re- 
ferring to said much required encoding param- 
eters and said little required encoding parame- 
ters. 

29. An encoding apparatus for encoding a base-band 
video signal : said encoding apparatus comprising: 

extraction means for extracting encoding pa- 
rameters of picture and higher layers from a 
vertical blanking period of said base-band vid- 
eo signal and encoding parameters of slice and 
lower layers from a horizontal blanking period 
of said base-band video signal; and 
re-encoding means for re-encoding said base- 
band video signal by referring to said encoding 
parameters of picture and higher layers and 
said encoding parameters of slice and lower 
layers. 

30. An encoding method adopted in an encoding appa- 
ratus for encoding a base-band video signal, said 
encoding method comprising the steps of: 

extracting encoding parameters of picture and 
higher layers from a vertical blanking period of 
said base-band video signal and encoding pa- 
rameters of slice and lower layers from a hori- 
zontal blanking period of said base-band video 
signal; and 

re-encoding said base-band video signal by re- 
ferring to said encoding parameters of picture 
and higher layers and said encoding parame- 
ters of slice and lower layers. 

31. An encoding apparatus for encoding a base-band 
video signal : said encoding apparatus comprising: 

extraction means for extracting general encod- 
ing parameters from a vertical blanking period 
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of said base-band video signal and detailed en- 
coding parameters from a horizontal blanking 
period of said base-band video signal; and 
re-encoding means for re-encoding said base- 
band video signal by referring to said general 5 
encoding parameters and said detailed encod- 
ing parameters. 

32. An encoding method adopted in an encoding appa- 
ratus for encoding a base-band video signal, said 10 
encoding method comprising the steps of: 

extracting general encoding parameters from a 
vertical blanking period of said base-band vid- 
eo signal and detailed encoding parameters '5 
from a horizontal blanking period of said base- 
band video signal; and 

re-encoding said base-band video signal by re- 
ferring to said general encoding parameters 
and said detailed encoding parameters. 20 
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stream with history data 



v ideo_sequence ( ){ 


No. of b i ts 


Mnemon i c 


hext_start_code ( ) 






sequence_header ( ) 






sequence_extension ( ) 






do{ 






extensi on_and__user_data (0) 






do{ 






if (nextbits( ) — group_start_code) { 






g roup_of _p i ctures_header (1 ) 






extension and user dataO) 






} 






picture_header ( ) 






picture_coding_extension( ) 






whi le((nextbits( )=extensi on_start_code) II 






(nextbi ts( )==user_data_start_code)) ( 






if (nextbi ts ( ) — extens ion_start_code) ) 






extensi on_data (2) 






■ if (nextbi ts(* }==user_data_start_code) { 






user_data_start_code 


32 


bslbf 


if (nextbitsC )=Hi story.OataJD) ( 






HistqryJJata^ID 


32 


bslbf 


converted_history__stream( ) 






) 






el se{ 






user_data( ) 






" " * 

} 






; 






J 






nifTiirA rla^ai ) 
f-f i L mi \Z __<J o. L a. v / 






}whi le((nextbi ts ( )==picture_start_code) II 






(nextbi ts( ) ==group_start_code) ) 






i f (nextb i ts ( ) ! =sequence_end_code) { 






sequencejieader ( ) 






sequence extensi on ( ) 






} 






}whi le (nextbi ts( ) ! =sequence_end_code) 






sequence end code 


32 


bslbf 


} 
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history stream(17-1) 



history_stream( ) { 


bits 


val ue 


sequence_header 






sequence_header_code 


32 


000001 63 


sequence_header_present_f lag 


1 




ho r i zonta 1 _s i ze_va 1 ue 


12 




marker_b i t 


1 


1 


ve rt i ca 1 _s i ze_va 1 ue 


12 




aspec t_rat i o_ i nf ormat i on 


4 




f rame_rate_code 


4 




maker_bi t 


1 


1 


bi t_rate_val ue 


18 




marker_b i t 


1 


1 


vbv_buf f er_s ize_value 


10 




const ra i ned_paramete r_f \ ag 


1 


0 


load_intra_quant iser_matri x 


1 




1 oad_rion_i nt ra_quant i ser_matr i x 


1 




maker_bi ts 


5 


1F 


i ntra_quant i ser_matr i x [64] 


8*64 




non_ i nt ra_quant i ser_mat r i x [64] 


8*64 










sequence__extens i on 






extens i on_start_code 


32 


000001 B5 


extens i on_start_code_ i dent i f i er 


4 


1 


sequence_extens i on_present_f 1 ag 


1 




prof i 1 e_and_ 1 eve 1 _i nd i cat i on 


8 




progress i ve_sequence 


1 




chroma_format 


2 




hori zontal_s i ze_extens i on 


2 




vert ical_s ize_extens ion 


2 




marker_bi t 


1 


1 


bi t_rate_extensi on 


12 




vbv_buf f er_s i ze_extens i on 


8 




1 ow_de 1 ay 


1 




marker_bi t 


1 


1 
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history stream (17-2) 





bits 


va 1 ue 


f rame_rate_extens i on_n 


2 




f rame_rate_extens ion_d 


5 




marker_bits 


6 


3F 








sequence_d i sp 1 ay_extens i on 






extens i on_start_code 


32 


000001 B5 


extens i on_start_code_ i dent i f i er 


4 


2 


sequence_d isplay_extens ion_present_f lag 


1 




video_format 


3 




co 1 our_desc r i pt i on 


1 




colour_primar ies 


8 




transfer_characteri sties 


8 




marker_bit 


1 


1 


mat r i x_coef f i c i ents 


8 




d i sp 1 ay_hor i zonta 1 _s i ze 


14 




marker_b« t 


1 


1 


d i sp 1 ay_ve rt i ca 1 _s i ze 


14 




marker_bi t 


1 


1 








macrob 1 ock_ass ignment_i n_user_data 






mac rob 1 ock_assignment_present_f 1 ag 


• 1 




marker_bit 


7 


7F 


v_phase 


8 




h_phase 


8 










group_of _p i cture_header 






group_start_code 


32 


000001 B8 


group_of_p i cture_header_present_f 1 ag 


1 




time code 


25 




c 1 osed_gop 


1 




broken_l i nk 


1 




marker_b«ts 


4 


F 








picture_header 






pi cture_start_code 


32 


00000100 
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history stream(17-3) 





bits 


value 


tempora preference 


10 




picture^coding type 


3 




marker_bi t 


1 


1 


vbv_de I ay 


16 




full pel forward vector 


1 





f orward_f _code 






f u 1 1 pe 1 backward vector 


1 

1 




marker_b i t 


1 

1 


i 
i 


backward_f code 


r> 
o 




marker_b i t 


1 
i 


i 
i 








p i c ture_cod i ng_extens i on 






extens i on_start code 


32 


000001 


extension start code identifier 


4 


o 


. f code[0][0] 


4 




f.code [0] [1] 


4 




f_code[1] [0] 


4 




f_code[1] [1] 


4 




i ntra_dc_prec i s i on 


2 




picture_structure 


2 




top_f ield_f irst 






f rame_pred_f rame dct 


! 




concealment__mot i on vectors 






q_scal e_type 


1 




marker_b» t 


1 


1 


intra_vl c_format 






al ternate_scan 






repeat_first field 






ch roma_420_t y pe 






progress i ve_f rame 






compos ite_di splay flag 






v_ax i s 






f i eld_sequence 


3 




sub_carr ier 


1 




burst_ampl i tude 


7 
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history stream (17-4) 





bits 


value 


marker_bi ts 


1 


1 


sub_carr i er_phase 


8 










quant_matr i x_extens i on 






extens i on_start_code 


32 


000001 B5 


extens i on_start_code_ident i f i er 


4 


3 


quant_matr i x_extens i on_present_f I ag 


1 




1 oad_ i nt r a_quant i se r_raat r i x 


1 




marker_bi ts 


2 


3 


i ntra quant i ser_mat r i x [64] 


8*64 




1 oad_non_ i ntra_quant i ser_matr i x 


1 




marker_b i ts 


7 


7Ff. 


non_ i nt ra quant i ser_mat r i x [64] 


8*64 




1 oad_chroraa_intra_quant i ser_matr i x 


1 




marker_bits 


7 


7F . 


chorma_i ntra_quant iser_matr i x[64] 


8*64 




load_chroma_non_intra_quant i ser_matr i x 


1 




marker_bits 


7 


7F 


chroma_non_ i nt ra_quant i ser_mat r i x [64] 


8*64 










copyr i ght_extensi on 






extens i on_start_code 


32 


000001 B5 


extens ion_start_code_ident i f i er 


4 


4 


copyr i ght_extens i on_present_f 1 ag 


1 




copyr ight_f lag 


1 




copyr i ght_i dent i f i er 


8 




or ig inal_or_copy 


1 




marker_bit 


1 




copyr i ght_number_1 


20 




marker_bi t 


1 




copyr i ght_number_2 


22 




marker_bi t 


1 




copyr i ght_number_3 


22 


3F 


marker_b i ts 


6 
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history stream (1 7-5) 





bits 


value 


P i cture_d i sp I ay__extens i on 






extens i on_start_code 


32 


000001 B5 


extens i on_start_code_ ident i f i er 


4 


7 


picture_di splay_extension_present_f lag 


1 




f rame_cent re_ho r i zonta I _of f set_1 


16 




marker_bit 


1 




f ra/ne_centre_vert ical_of fset_1 


16 




marker_bit 


1 


1 


f rame_cent r e_ho r i zonta 1 _of f se t_2 


16 




marker_bit 


1 


1 


f rame_cent re_ve r t i ca 1 _o f f set_2 


16 




marker_bit 


1 


1 


f rame_cent rejior i zonta 1 _of f set_3 


16 




marker_bit 


1 


1 


f rame_cent re_vert i ca 1 _of f set_3 


16 




marker_bit 


6 


3F 








re_cod i ng_st ream_ i nf ormat i on 






user_data_start^code 


32 


000001 B2 


re_cod i ng_st ream. i nf o_ID 


16 


91 EC 


red_b*_f lag 


1 




red_bw_ i nd i cator 


2 




maker_b i t 


5 


1F 








user_data 






user_data_start_code 


32 


000001B2 


user_data 


2048 










whi le (mac rob lock i =macrob 1 ock_count) { 






macroblock 






macroblock_address_h 


8 




macroo iocK_aooress_v 


o 
0 




si ice_header_present_f lag 


1 




skipped_macroblock_f lag 


1 




marker_bit 


1 


1 








nacroblock_modes( ) 






mac r ob 1 ock_quant 


1 




mac rob 1 ock_mot i on_f orward 


1 




mac rob 1 ock_mot i on_backward 


1 




mac rob 1 ock_pattern 


1 




mac rob 1 ock_ i nt ra 


1 
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history stream(17-6) 





bits 


val ue 


spat i a l_tempora I _we i ght_code_f I ag 


1 




f rame_mot i on_type 


2 




f i e 1 d_mot i on_type 


2 




dct_type 


1 




marker_bi ts 


2 


3 








quant iser_scal e_code 


5 




marker_b i ts 


3 


7 








PMVCO] [0] [0] 


14 




marker_bi ts 


2 


3 


PMVCO] [0][1] 


14 




mot i on_ve rt i ca 1 _f i e 1 d_se 1 ect [0] [0] 


1 




marker_bi t 


1 


1 - 


PMV[0][1][0] 


14 




marker_bi ts 


2 


3 


PMV[0][1][1] 


14 




mot i on_vert i ca I _f i e I d_se I ect [0] [1] 


1 




marker_bi t 


1 


1 


PMVtUCO] [0] 


14 




marker_bi ts 


2 


3 


PMVC1] CO] Ci] 


14 




mot i on_ve rt i ca 1 _f i e 1 d_se 1 ect [1 ] [0] 


1 




marker_bit 


1 


1 


PMV[1] (1] [0] 


14 




marKe r_D i ts 


z 


i 


PMvmmm 


14 




mot i on_vert i ca L f i e I d_se 1 ect [1 ] [ 1 ] 


1 




marker_bit 


1 


1 








coded_bl ock_pattern 


12 




marker_bi ts 


4 


F 


num_mv_b i ts 


8 




num_coef_bi ts 


14 




marker_bi ts 


2 


3 
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history st ream(17-7) 





bits 


value 


num_other_b i ts 


7 




marker bit 


1 


1 


} 
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history_stream( ) { 


No. of bits 


Mnemon i c 


next_start_code ( ) 






sequence ^header ( ) 






sequence_extension( ) 






extens i on_and_use r_data (0) 






if(nextbits( ) — group__start_code) { 






group_of_pictures_header ( ) 






extension and user data(1) 






} 






picturejieader ( ) 






picture_coding_extension( ) 






re_coding_stream_info ( ) 






extens i ons_and_user_data (2) 






picture_data( ) 






sequence end code 


32 


bslbf 


} 
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sequence_neaoe r v / l 


riO* OT OILS 


win emu n i c 


sequence_header_code 


32 


bslbf 


ho r i zonta 1 _s i ze_va 1 ue 


12 


u imsbf 


ve r t i ca 1 _s i ze_va 1 ue 


12 


u i mabf 


aspec t_rat i o_ i n f o rmat ion 


4 


uimsbf 


f rame_rate_code 


4 


uimsbf 


b i t_rate_va 1 ue 


18 


uimsbf 


marker_bi * 


1 


bslbf 


vbv_buf f er_s i ze.va 1 ue 


10 


u imsbf 


constrained_parameters_f lag 


1 


bslbf 


load_i ntra_quant i ser_matr i x 


1 


u imsbf 


i f ( 1 oad_ i n t ra_q uan t i se r_mat r i x) 






i nt ra_quan t i se r_mat r i x [64] 


8*64 


u imsbf 


load_non_intra_quant iser_matr i x 


1 


u imsbf 


if (load_non_intra_quant i ser_matri x) 






non_ i n t ra_quan t i se r_mat r i x [64] 


8*64 


u imsbf 


next_start_code ( ) 






} 
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sequence__extensi on ( )[ 


No. of bits 


Mnemon i c 


extens i on_start_code 


oZ 


bslbf 


extens i on_start_code_j dent i f i er 


4 


uimsbf 


prof i le_and_leve l_indicat ion 


8 


uimsbf 


progress i ve_sequence 


1 


uimsbf 


chroma^f ormat 


2 


uimsbf 


hor i zonta 1 _s i ze_extens i on 


2 


uimsbf 


vert ica!_size_extens ion 


2 


uimsbf 


b i t_rate_extens i on 


12 


uimsbf 


marker_bit 


1 


bslbf 


vbv_buf f er_s ize_extens i on 


8 


u imsbf 


I ow_de 1 ay 


1 


uimsbf 


f rame_rate_extens i on_n 


2 


u imsbf 


f rame_rate_extens i on__d 


5 


uimsbf 


next_start code ( ) 






} 
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extens ion_and_user_data (i) { 


No. of bi ts 


Mnemon i c 


whi 1 e ( (nextb i ts ( ) —extens ion_start_code) || 






(nextbits( )=user_data_start_code)) { 






i f ( ( i =2) &6 (nextb i ts ( ) =extens i on_start_code) ) 






extens ion_data(i) 






if (nextb its ( )=user_data_start_code) 






user data( ) 






} 






} 
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user_data( ) { 


No. of bits 


Mnemon i c 


user_data_start_code 


32 


bslbf 


*hile(nextbits( )!= '0000 0000 0000 0000 0000 000V ) { 






user data( ) 


8 


uimsbf 


} 






next start code ( ) 






} 







F I G. 2 9 



group_of_pictures_header ( ){ 


No. of bits 


Mnemon i c 


group_start_code 


32 


bslbf 


time_code 


25 


bslbf 


closed.gop 


1 


uimsbf 


broken_l ink 


1 


uimsbf 


next start code( ) 






} 
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p icture_header ( ) { 


No. of bits 


Mnemon ic 


picture_start_code 


32 


bslbf 


tempora preference 


10 


uimsbf 


p icture_coding_type 


3 


u imsbf 


vbv.de I ay 


16 


uimsbf 


if (picture_coding_type=2 II picture_coding_type==3) { 






ful I _pe l__forward_vector 


1 


bslbf 


forward f code 


3 


bslbf 


} 






i f (picture_coding_type==3) { 






ful l_pel_forward_vector 


1 


bslbf 


backward_f code 


3 


bsibf 


} 






whi le(nextbits( )= T) { 






extra_bit_picture/*wi th the value TV 


1 


uimsbf 


extra information picture 


8 


uimsbf 


} 






extra_bi t_picture/*wi th the value *0' */ 


1 


uimsbf 


next start code ( ) 






} 
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picture_coding_extension( ) { 


k t X L * i- 

No. of bits 


Mnemon i c 


extens ion_start_code 


32 


bslbf 


extens i on_start_code_ i dent i f i er 


4 


u imsbf 


f_code [0] [0] /*forward horizontal V 


4 


u imsbf 


f_code [0] [1] /^forward vertical V 


4 


u imsbf 


f_code LI J [OJ /'backward horizontal V 


4 


uimsbf 


f_code LU Lu /'backward vertical V 


4 


u imsbf 


i n t ra_dc_p rec i s i on 


2 


u imsbf 


picture_structure 


2 


u imsbf 


top_f ield_f irst 


3 — 


u imsbf 


f rame_pred_f rame_dct 


1 


u imsbf 


concea lment_mot i on^vectors 


— 


* _ L X 

u imsbf 


q — sea 1 e_type 


} — 


u imsbf 


i nt ra_vlc_f ormat 




u i msbf 


a i Ternate_scan 


1 


u i msbf 


repeat_f i rst_f i e 1 d 


1 


u i msbf 


chroma_420_type 




u imsbf 


progress ive_f rame 




u imsbf 


compos i te_d i sp 1 ay_f 1 ag 




uimsbf 


i f (compos i te_d i sp 1 ay_f I ag) { 






v_ax i s 




uimsbf 


f le ld_sequence 


3 


uimsbf 


sub.carr ier 




uimsbf 


burst_ampl i tude 


7 


uimsbf 


sub carrier phase 


8 


uimsbf 


} 






next_start_code 0 






} 
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extens i on_data ( ) ( 


No of bits 




whi le(nextbits( ) "extens ion_start__code) { 






extens i on_s tart_code 


32 


K<i 1 hf 
US 1 DT 


if (i==0)/*fol lows seauence extension( )*/ 






seouence di^Dlav pxfpn^ i nn f ^ 






/ * NOTE - 1 never takes the value 1 heransp p*fpn«;inn Aa¥a ( ' 






never follows a group_of _pictures_header ( )*/ 






if (i=2)/*follows picture_coding_extension( )*/ 






if (nextbits( )== "Quant Matrix Extension ID") 






quant matrix_extension( ) 






else if (nextbits( )= "Copyright Extension [D") 






copyright_extens i on ( ) 






else 






picture_d isplay extension( ) 






} 






} 
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quant_matrix_extension( ) { 


No. of bits 


Mnemon ic 


extens ion_start_code_ i dent i f i er 


4 


u imsbf 


load_i nt ra_quanti ser_matr ix 


1 


u i msbf 


i f ( 1 oad_ i nt ra_quant i se r_mat r i x) 






intra_quantiser_matr ix [64] 


8*64 


u imsbf 


1 oad_non_i ntra_quant i ser_matr i x 


1 


u imsbf 


if (load_non_intra_quant iser_matri x) 






non_intra_quanti ser_matrix [64] 


8*64 


uimsbf 


load_chroma_intra_quant iserjnatri x 


1 


u imsbf 


if (load_chroma_intra_quantiser_matri x) 






chromaJntra_quantiser_matrix [64] 


8*64 


u imsbf 


load_chroma_non_i ntra_quant iserjnatr i x 


1 


u imsbf 


i f ( 1 oad_chroma_non_i ntra_quant i ser mat r i x) 






chrofna_non_ i nt ra_quant i serjnat r i x [64] 


8*64 


u imsbf 


next_start code( ) 






} 
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copyr ight_extension( ){ 


No. of bi ts 


Mnemon ic 


extens i on_s ta rt_code_ i dent i f i e r 


4 


u imsbf 


copyr ight_f lag 


1 


bslbf 


copyrights dent if ier 


8 


u imsbf 


original_o r_copy 


1 


bslbf 


reserved 


7 


u imsbf 


marker_bit 


1 


bslbf 


copyr ight_number_1 


20 


u imsbf 


marker_bit 


1 


bslbf 


copyr i ght_number_2 


22 


u imsbf 


marker_bi t 


1 


bslbf 


copyr i ght_nuraber_3 


22 


u imsbf 


next_start_code ( ) 






} 
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p i c ture_d i sp 1 ay_extens i on( ) { 


No. of bi ts 


Mnemon i c 


extens i on_start_code_i dent i f i er 


4 


uimsbf 


for(i=0;i ",number_of_f rame_centre_of fsets) { 






f rame_centre_horizontal_of f set 


16 


s imsbf 


marker bit 


1 


bslbf 


f rame_cent re_vert i ca 1 _of f set 


16 


s imsbf 


marker_bi t 


1 


bslbf 


} 






next_start_code ( ) 






} 
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pi cture_data 0 { 


No. of bits 


Mnemon i c 


do{ 






s 1 ice () 






}whi leCnextbitsO^sl ice_start_code) 






next_start codeO 






} 
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si ice ( ) { 


No. of bits 


Mnemon i c 


si ice_start_code 


32 


bslbf 


s 1 i ce_quant i ser_sca 1 e_code 


5 


u imsbf 


if (nextbit( )*= " 1 ' ) { 






intra_sl ice_f lag 


1 


bslbf 


intra_sl ice 


1 


u imsbf 


reserved_bits 


7 


u imsbf 


whi le(nextbits( )== T) { 






extra_bit_sl ice/*with the value TV 


1 


u imsbf 


extra information slice 


8 


u imsbf 


} 






} 






extra_bit_sl ice/*with the value 'O'V 


1 


uimsbf 


do{ 






macroblock( ) 






}while(nextbit( )!= '000 0000 0000 0000 0000 0000*) 






next start code( ) 






} 
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mac rob lock ( ) { 


No. of bi ts 


Mnemon i c 


whi le(nextbi ts( )== 0000 0001 000 ) 






mac rob 1 ock_escape 


11 


bslbf 


mac rob 1 ock_address_ i nc rement 


1-11 


vlclbf 


mac rob 1 ock_rnodes ( ) 






* r / ill l \ 

i f (mac rob 1 ock_quant; 






mac tod i ock_ quant i sc r_ sea i e_coae 


c 
0 


: 

u i msbf 


if (!red_bw_f lag II 






(red_b*L.f lag &&(red bw i nd icator 1) ) ) { 






i f (macroblock_mot i on_f orward II 






(mac rob I ock_ intra IL concealmentjnot ion_vectors)) 






mot i on_vectors (0) 






i f (mac rob I ock_mot i on_backward) 






mot i on_vectors (1) 






if (mac rob I ock_ intra && concealmentjnot ion_vectors) 






marker_bi t 


1 


bslbf 


} 






i f (mac rob I ock_pattern && 






(!red_bw_f lag II 






(recLbw.f I ag && (red_bw_i nd i cator — 0) ) ) 






coded_block pattern ( ) 






} 
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macroblock_modes ( ){ 


No. of bits 


Mnemonic 


mac roblock_type 


1-9 


vlclbf 


* r / l it r i II 

if (!red_bw_f lag tl 






(red_bw_f lag && (red_bw_i nd i cat or ^ 1 ) ) ) { 






* r / III I " T III 

1 1 (macrob 1 ock_mot i on_f orward II 






LI 1 i * | i t\ f 

macrobl ock_mot i on_backward) { 






i t vpiCLure struciure — Trajne j \ 






i f (f rame_pred_f rame_dct==0) 






f rame_mot i on_type 


2 


uimsbf 


} e 1 se { 






field motion type 


2 


uimsbf 


} 






} 






} 






i f ( (pi cture_structure== "Frame Picture")fe& 






(f rame_p r ed_f rame_dc t==0) 6& 






(dct_type_f lag==1)&& 






(!red_bw_f lag II 






(redjw.f lag tt(red_bw_indicator<1)))) { 






dct_type 


1 


ui msbf 


} 






} 
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mot i on_vectors (s) { 




mneiTion i c 


i f (mot ion_vector_count==1) { 






i f ( (mv_f ormat==f i e 1 d) && (dmv ! =1 ) 






not i on_vert i ca l_f i e 1 d_se 1 ect [0] [s] 


1 


u i msbf 


mot ion_vector (0, s) 






}else{ 






mot i on_ve r t i ca 1 _f i e 1 d_se 1 ect [0] [s] 


1 


u i msbf 


mot i on_vector (0, s) 






mot ion_vert ical_f iel deselect [1] [s] 


1 


uimsbf 


mot ion vector (1, s) 






} 






} 
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mot i on_vectors (r, s) { 


No. of bits 


Mnemon i c 


motion_code[r] [s] [0] 


1-11 


viclbf 


if ((f_code[s][0] !=1)44(motion_code[r] [ s ] [0] !=0)) 






mot i on_res i dua 1 [r] [s] [0] 


1-8 


u i msbf 


if (dmv— 1) 






dmvector[0] 


1-2 


viclbf 


motion_code[r] [s] [1] 


1-11 


viclbf 


i f (f .code [s] (1 ] ! =1 ) 44 (mot i on.code [r] [s] [1 ] ! =0) ) 






mot i on_res i dua 1 [r] [s] [1 ] 


1-8 


u imsbf 


if (dmv==1) 






dmvector[1] 


1-2 


viclbf 


} 
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macroblock_type 


V L C 


code 




mac rob I ock_quant 






dc 


t_type_f I ag 








mac rob I ock_mot i on_f orward 










mac rob I ock_mot i on_ backward 












Oescr i pt i on 


1 


0 


1 


0 


0 


Intra 


01 


1 


1 


0 


0 


Intra, Quant 
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macroblock_type VLC code 




mac rob 1 ock_quant 






dct_type_f lag 








mac rob I ock_mot i on_f orward 










macrob I bck_mbt ion_backward 












Description 


1 


0 


1 


1 


0 


MC, Coded 


01 


0 


1 


0 


0 


No MC, Coded 


001 


0 


0 


0 


0 


MC, Not Coded 


0001 1 


0 


1 


0 


0 


Intra 


0001 0 


1 


1 


1 


0 


MC, Coded. Quant 


0000 1 


1 


1 


0 


0 


No MC, Coded, Quant 


0000 01 


1 


1 


0 


0 


Intra, Quant 



78 



EP 1 111 932 A2 



FIG. 44 



mac rob lock_type 
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